Commit Graph

488 Commits

Author SHA1 Message Date
BohuTANG
ee6ac28773 ISSUES-4006 fix up meta parse 2020-08-17 16:27:34 +08:00
BohuTANG
6557e706c9 ISSUES-4006 fix special build check errors #4006 2020-08-17 16:01:18 +08:00
BohuTANG
a8465cfce6 ISSUES-4006 move MySQL command to the PacketsGeneric.h #4006 2020-08-17 15:27:35 +08:00
BohuTANG
cfc1fea619 ISSUES-4006 add startBinlogDumpGTID api for MySQLClient #4006 2020-08-17 15:21:20 +08:00
BohuTANG
059bf166ae ISSUES-4006 add GTID unit tests #4006 2020-08-17 14:45:43 +08:00
BohuTANG
3ccc650995 ISSUES-4006 add position.Dump() #4006 2020-08-17 09:30:16 +08:00
BohuTANG
e90679707a ISSUES-4006 add MySQL replication GTIDEvent #4006 2020-08-17 09:23:54 +08:00
BohuTANG
b4d18b1a52 ISSUES-4006 add MySQL replication GTID module #4006 2020-08-17 09:02:59 +08:00
Vitaly Baranov
2909ed1bc0 Better initialization of access storages. Make list of access storages dynamic. 2020-08-16 19:15:34 +03:00
feng lv
aaedf02d2b fix conflict 2020-08-16 12:38:39 +08:00
zhang2014
fe49bd3414 Merge branch 'master' of github.com:yandex/ClickHouse into refactor/materialize_mysql_database 2020-08-15 16:12:46 +08:00
alexey-milovidov
ea79c53ed2
Merge pull request #13735 from azat/gcc10-build-fixes-20.7
Fix compilation with gcc10 and libstdc++
2020-08-15 11:01:14 +03:00
zhang2014
2f3042ba86 ISSUES-4006 try fix build 2020-08-15 11:16:55 +08:00
Azat Khuzhin
194d1d514c Fix compilation MySQLReplication with gcc10 and libstdc++
gcc10 reports:
    ../src/Core/MySQLReplication.cpp:62:46: error: use of deleted function ‘std::basic_ostream<char, _Traits>& std::operator<<(std::basic_ostream<char, _Traits>&, char8_t) [with _Traits = std::char_traits<char>]’
2020-08-14 22:15:17 +03:00
zhang2014
b49c3cebb5 ISSUES-4006 try fix build 2020-08-14 23:52:47 +08:00
Alexander Tokmakov
128b19fdba Merge branch 'master' into use_atomic_engine_for_system_db 2020-08-14 13:47:44 +03:00
zhang2014
4199baf69d Merge branch 'master' of github.com:yandex/ClickHouse into refactor/materialize_mysql_database 2020-08-14 13:30:12 +08:00
zhang2014
7ff62b090e ISSUES-4006 try fix build and style failure 2020-08-14 09:59:59 +08:00
alexey-milovidov
eeefcd6493
Merge pull request #13337 from ClickHouse/refactor-pipes-3
Refactor Pipe
2020-08-14 04:12:22 +03:00
zhang2014
e3b78c5a31 ISSUES-4006 try fix build and style failure 2020-08-14 00:51:51 +08:00
zhang2014
57bf007b82 ISSUES-4006 add ya make 2020-08-13 20:51:29 +08:00
zhang2014
96bd3ac34b ISSUES-4006 split mysql protocol 2020-08-13 20:41:36 +08:00
zhang2014
34f4c8972e ISSUES-4006 split replication packets 2020-08-13 20:07:02 +08:00
zhang2014
4061254cb1 ISSUES-4006 split authentication 2020-08-13 18:39:15 +08:00
zhang2014
c76d7e3121 ISSUES-4006 split generic packets 2020-08-13 18:17:13 +08:00
zhang2014
57c772e3aa ISSUES-4006 split connection packets 2020-08-13 17:38:00 +08:00
zhang2014
c0d42b764e ISSUES-4006 split protocol text packet 2020-08-13 17:20:45 +08:00
zhang2014
4fcc178deb ISSUES-4006 split mysql protocol 2020-08-13 16:17:33 +08:00
zhang2014
688836cdc4 ISSUES-4006 split msql protocol & fix build 2020-08-13 14:30:29 +08:00
zhang2014
0162c39838 ISSUES-4006 split mysql protocol 2020-08-13 13:02:16 +08:00
Alexander Tokmakov
a6ff049eec use Atomic for system database 2020-08-12 23:40:13 +03:00
tavplubix
4aff48dc3f
Merge pull request #10851 from zhang2014/feature/materialize_mysql_database
ISSUES-4006 support MaterializeMySQL database engine
2020-08-12 15:59:28 +03:00
Alexander Tokmakov
829f7e65de try fix sync, add experimetal flag 2020-08-12 00:59:46 +03:00
Nikolai Kochetov
9b67cd9faf Merge branch 'master' into refactor-pipes-3 2020-08-10 10:50:17 +03:00
Alexey Milovidov
edd89a8610 Fix half of typos 2020-08-08 03:47:03 +03:00
zhang2014
d6bba8cbbb ISSUES-4006 add settings for allows_query_when_mysql_lost & move dump event to logger 2020-08-07 14:12:27 +08:00
zhang2014
bd21f8e6b9 ISSUES-4006 fix conflicts commit when merge 2020-08-07 12:55:45 +08:00
Nikolai Kochetov
d83c7cc0e6 Merge branch 'master' into refactor-pipes-3 2020-08-06 17:32:50 +03:00
Nikolai Kochetov
20e63d2271 Refactor Pipe [part 6] 2020-08-06 15:24:05 +03:00
Alexander Kuzmenkov
45b57f2df5 fixes 2020-08-06 00:53:35 +03:00
Alexander Kuzmenkov
5c2d7fc569 fixes 2020-08-05 18:45:44 +03:00
Alexander Kuzmenkov
d205b20c04 wip 2020-08-05 05:21:33 +03:00
zhang2014
34f7fac76c ISSUES-4006 try fix test failure 2020-08-04 12:22:12 +08:00
zhang2014
c173bd391f ISSUES-4006 try fix build & test failure 2020-08-04 10:31:27 +08:00
zhang2014
b76f218d90 ISSUES-4006 add mysql dml test 2020-08-04 10:31:27 +08:00
zhang2014
9996166860 ISSUES-4006 try fix check style 2020-08-04 10:31:27 +08:00
zhang2014
ad187384f0 ISSUES-4006 try fix build failure 2020-08-04 10:31:27 +08:00
zhang2014
74f354d840 ISSUES-4006 add some check before create materialize mysql database 2020-08-04 10:31:27 +08:00
zhang2014
95b8afb8eb ISSUES-4006 try fix unit test failure 2020-08-04 10:31:26 +08:00
zhang2014
1930b8f584 ISSUES-4006 support drop materialize mysql database engine 2020-08-04 10:31:26 +08:00
zhang2014
6562597064 ISSUES-4006 refactor interpreter 2020-08-04 10:31:26 +08:00
zhang2014
4a99ca0d80 ISSUES-4006 refactor 2020-08-04 10:31:25 +08:00
zhang2014
59465b58c2 ISSUES-4006 fix cmake 2020-08-04 10:31:25 +08:00
zhang2014
0336a4ad58 ISSUES-4006 suport synchronous MySQL incremental data[part 2] 2020-08-04 10:31:23 +08:00
zhang2014
0c52d425ba ISSUES-4006 suport synchronous MySQL incremental data 2020-08-04 10:29:54 +08:00
BohuTANG
5f80db7569 Fix MySQL 8.0 AuthSwitch packet read 2020-08-04 10:26:22 +08:00
BohuTANG
2a0e79c145 Fix MySQL 8.0 optional metadata fields read in TableMapEvent 2020-08-04 10:26:22 +08:00
BohuTANG
3477a467e6 Add master connect flags and change DryRunEvent parse to ignore 2020-08-04 10:26:22 +08:00
BohuTANG
882a773264 Support database replicate filter 2020-08-04 10:26:22 +08:00
BohuTANG
d2aa1f9a47 Disable XA ROLLBACK and SAVEPOINT type for QueryEvent 2020-08-04 10:26:22 +08:00
BohuTANG
ec9345785b Change flavor event to private 2020-08-04 10:26:22 +08:00
BohuTANG
644667adff Change the method print() to dump() 2020-08-04 10:26:22 +08:00
BohuTANG
8090cf1a00 Add default branch to compressed_decimals read 2020-08-04 10:26:22 +08:00
BohuTANG
939bc413ba Move replicate filter to the MySQL server 2020-08-04 10:26:22 +08:00
BohuTANG
9f0e74ff93 Change the MySQL Client api from bool to throw execption 2020-08-04 10:26:22 +08:00
BohuTANG
5c23583cda Add DEMICAL type 2020-08-04 10:26:22 +08:00
BohuTANG
5219a34b32 Add QueryEvent type 2020-08-04 10:26:22 +08:00
BohuTANG
81998cb1af Support DATETIME/TIMESTAMP type 2020-08-04 10:26:22 +08:00
BohuTANG
a36ef50f92 Support more types 2020-08-04 10:26:22 +08:00
BohuTANG
31818388be Support Int8/Int16/Int24 type 2020-08-04 10:26:22 +08:00
BohuTANG
b0657236f6 Add Null type value parse 2020-08-04 10:26:22 +08:00
BohuTANG
2864368716 Fix conflicting file 2020-08-04 10:26:22 +08:00
BohuTANG
02011ae42f Add binlog event parser 2020-08-04 10:26:22 +08:00
BohuTANG
79af54c791 add DryRun event 2020-08-04 10:26:22 +08:00
BohuTANG
3c991db64b fix clang expection error 2020-08-04 10:26:22 +08:00
BohuTANG
eaff3836ef move type() to the base class 2020-08-04 10:26:22 +08:00
BohuTANG
9c2ecf008c fix clang build 2020-08-04 10:26:22 +08:00
BohuTANG
c899c34f03 add mysql replication class 2020-08-04 10:26:22 +08:00
BohuTANG
e32fc1865d fix clang build 2020-08-04 10:26:22 +08:00
BohuTANG
c91a810d2d add binlog event 2020-08-04 10:26:22 +08:00
BohuTANG
0d3cab3e10 fix openssl build 2020-08-04 10:26:22 +08:00
BohuTANG
99402fac85 fixup clang tidy errors 2020-08-04 10:26:22 +08:00
BohuTANG
ef4126d533 add com_binlog_dump 2020-08-04 10:26:22 +08:00
BohuTANG
27e2fe2778 add register slave command 2020-08-04 10:26:22 +08:00
BohuTANG
4a21fce889 fix packet response capability to client 2020-08-04 10:26:22 +08:00
BohuTANG
44cd5534b4 make getPayloadSize protected 2020-08-04 10:26:22 +08:00
BohuTANG
b23816799c add read columns 2020-08-04 10:26:22 +08:00
BohuTANG
6cac6a4f76 add mysql protocol test 2020-08-04 10:26:22 +08:00
BohuTANG
b9e2c0d72c add gtest for MySQL Protocol handshake 2020-08-04 10:26:21 +08:00
BohuTANG
f5a53dd270 handshake auth ok 2020-08-04 10:26:21 +08:00
BohuTANG
1a9118d722 add error to MySQL client connect 2020-08-04 10:26:21 +08:00
BohuTANG
ab8b847e66 add OK/ERR packet parse 2020-08-04 10:26:21 +08:00
BohuTANG
c1332834a9 add ERR packet parse 2020-08-04 10:26:21 +08:00
BohuTANG
3b7a0f92a8 fix the handshake packet 2020-08-04 10:26:21 +08:00
BohuTANG
8c4dc62ebb make ReadPacket public and change variables in constructor function 2020-08-04 10:26:21 +08:00
BohuTANG
63c0f495b9 MySQL: make MySQLProtocol work in server&client duplex mode 2020-08-04 10:26:21 +08:00
Vitaly Baranov
a804f9499d Use references while iterating through settings. 2020-08-04 04:00:38 +03:00
Alexander Tokmakov
5b92f43f12 Merge branch 'master' into database_atomic_improvements 2020-08-03 14:35:40 +03:00
Alexey Milovidov
6f690b7c0d Normalize ya.make files, fix "Arcadia" build 2020-08-02 16:57:38 +03:00
feng lv
88e48168d9 fix 2020-08-02 13:35:58 +08:00
feng lv
edb7c9b2c5 fix conflict 2020-08-02 11:27:32 +08:00
feng lv
fdf646283d fix
fix
2020-08-02 09:59:25 +08:00
Vitaly Baranov
80a3caef1c Allow using any types for custom fields. 2020-07-31 20:57:49 +03:00
Vitaly Baranov
442f3de5a8 Implement custom settings. 2020-07-31 20:57:43 +03:00
Vitaly Baranov
56665a15f7 Rework and rename the template class SettingsCollection => BaseSettings. 2020-07-31 20:54:18 +03:00
Vitaly Baranov
e40a8ac176 Use names of the settings instead of their indices in SettingsConstraints and settings profiles. 2020-07-31 19:11:27 +03:00
Vitaly Baranov
300727afa3 Rework the StringField* classes and make conversion String => StringField* explicit. 2020-07-31 19:11:27 +03:00
Vitaly Baranov
18e3f1f60d Split SettingsCollection.h into 3 files: SettingsFields.h, SettingsEnums.h, SettingsCollection.h 2020-07-31 19:11:27 +03:00
Vitaly Baranov
90602b869a Make SettingsChanges a class. 2020-07-31 19:11:27 +03:00
Vitaly Baranov
d152e84a2e Rename Setting* => SettingField*. 2020-07-31 19:11:27 +03:00
Vitaly Baranov
4ad99f1472 Make type names of settings shorter: SettingUInt64 => UInt64. 2020-07-31 19:11:27 +03:00
Vitaly Baranov
668653600c Use SettingMaxThreads only in Settings, call getNumberOfPhysicalCPUCores() instead of SettingMaxThreads::getAuto(). 2020-07-31 19:11:27 +03:00
Vitaly Baranov
30b34e6a15 Use SettingSeconds only in Settings, use std::chrono::seconds in other places. 2020-07-31 19:11:27 +03:00
Vitaly Baranov
b76b23ce31 Better conversion of String and std::string_view to Field. 2020-07-31 19:11:27 +03:00
alexey-milovidov
9c9ef0db9b
Merge branch 'master' into database_atomic_improvements 2020-07-31 14:56:49 +03:00
alexey-milovidov
74edcfb87e
Merge pull request #13073 from nikitamikhaylov/rewrite-tests
BayesAB test
2020-07-31 02:30:07 +03:00
Nikita Mikhaylov
4d49d2c671 another removes 2020-07-30 13:31:14 +03:00
Nikita Mikhaylov
1d6c2ba689 rewrite other test + remove useless includes 2020-07-29 20:37:57 +03:00
alesapin
7a806eb90f
Merge pull request #13017 from ClickHouse/freeze_partition_with_name
Alter table freeze with verbose output
2020-07-29 18:42:48 +03:00
Alexander Kuzmenkov
f6f2812f73 Block structure mismatch is a program error 2020-07-28 21:35:18 +03:00
alesapin
c75830e878 Alter table freeze with verbose output 2020-07-28 18:10:36 +03:00
Alexander Tokmakov
6bfe88e83f Merge branch 'master' into database_atomic_improvements 2020-07-26 13:40:05 +03:00
Winter Zhang
50203a5dc0
ISSUES-12293 allow push predicate when subquery contains with clause (#12663) 2020-07-24 12:00:18 +03:00
Alexander Tokmakov
237accd154 Merge branch 'master' into database_atomic_improvements 2020-07-23 06:33:20 +03:00
Artem Zuikov
2afd123eda
Refactoring: extract TreeOptimizer from SyntaxAnalyzer (#12645) 2020-07-22 20:13:05 +03:00
alexey-milovidov
7935b6a9f7
Merge pull request #12635 from ClickHouse/alter_non_metadata
Add setting allow_non_metadata_alters
2020-07-22 16:29:14 +03:00
Alexander Tokmakov
9bcaaea3e0 Merge branch 'master' into database_atomic_improvements 2020-07-22 05:24:48 +03:00
Alexey Milovidov
7b81640e9b Add support for function if with Array(UUID) arguments #11066 2020-07-22 00:15:19 +03:00
alesapin
3946f89878 Fix setting description 2020-07-21 17:08:23 +03:00
alesapin
daaa5cc382 Add setting allow_non_metadata_alters 2020-07-21 17:05:30 +03:00
Alexander Tokmakov
99f0adad0a fixes 2020-07-17 21:17:04 +03:00
Alexander Tokmakov
c27de9b424 fixes 2020-07-17 16:11:44 +03:00
Artem Zuikov
c6e3e9b1ff
String convertion to enum in if() and transform() (#12515) 2020-07-17 12:28:51 +03:00
Alexander Tokmakov
a612080df1 Merge branch 'master' into database_atomic_improvements 2020-07-17 00:43:59 +03:00
Denis Glazachev
59cb758cf7 Merge branch 'master' into ldap-per-user-authentication 2020-07-16 02:29:24 +04:00
Artem Zuikov
5f01a587f6
Optimize monotonous ORDER BY (#12467) 2020-07-15 13:10:21 +03:00
Alexander Tokmakov
09abe71b60 Merge branch 'master' into database_atomic_improvements 2020-07-15 13:07:08 +03:00
Artem Zuikov
dda2510208
Try enable multiple_joins_rewriter_version v2 by default (#12469) 2020-07-14 12:34:47 +03:00
Alexander Tokmakov
fdb02edc7c Merge branch 'master' into database_atomic_improvements 2020-07-13 17:28:48 +03:00
Alexander Tokmakov
15b395da51 fixes 2020-07-13 17:24:00 +03:00
Denis Glazachev
f787702922 Merge branch 'master' into ldap-per-user-authentication
* master: (27 commits)
  Whitespaces
  Fix typo
  Fix UBSan report in base64
  Correct default secure port for clickhouse-benchmark #11044
  Remove test with bug #10697
  Update in-functions.md (#12430)
  Allow nullable key in MergeTree
  Update arithmetic-functions.md
  [docs] add rabbitmq docs (#12326)
  Lower block sizes and look what will happen #9248
  Fix lifetime_bytes/lifetime_rows for Buffer direct block write
  Retrigger CI
  Fix up  test_mysql_protocol failed
  Implement lifetime_rows/lifetime_bytes for Buffer engine
  Add comment regarding proxy tunnel usage in PocoHTTPClient.cpp
  Add lifetime_rows/lifetime_bytes interface (exported via system.tables)
  Tiny IStorage refactoring
  Trigger integration-test-runner image rebuild.
  Delete log.txt
  Fix test_mysql_client/test_python_client error
  ...
2020-07-13 15:46:27 +04:00
Artem Zuikov
b5c181c24e
Optimize redundant functions in ORDER BY (#12404) 2020-07-13 13:34:25 +03:00
alexey-milovidov
7108f88de5
Merge pull request #12424 from ClickHouse/lower-default-block-size
Lower block sizes and look what will happen
2020-07-13 05:32:25 +03:00
Alexey Milovidov
bc8e7e04df Lower block sizes and look what will happen #9248 2020-07-12 04:05:09 +03:00
Denis Glazachev
edb6ef8c09 Merge commit 'ceac649c01b0158090cd271776f3219f5e7ff57c' into ldap-per-user-authentication
* commit 'ceac649c01b0158090cd271776f3219f5e7ff57c': (75 commits)
  [docs] split misc statements (#12403)
  Update 00405_pretty_formats.reference
  Update PrettyCompactBlockOutputFormat.cpp
  Update PrettyBlockOutputFormat.cpp
  Update DataTypeNullable.cpp
  Update 01383_remote_ambiguous_column_shard.sql
  add output_format_pretty_grid_charset setting in docs
  add setting output_format_pretty_grid_charset
  Added a test for #11135
  Update index.md
  RIGHT and FULL JOIN for MergeJoin (#12118)
  Update MergeTreeIndexFullText.cpp
  restart the tests
  [docs] add syntax highlight (#12398)
  query fuzzer
  Fix std::bad_typeid when JSON functions called with argument of wrong type.
  Allow typeid_cast() to cast nullptr to nullptr.
  fix another context-related segfault
  [security docs] actually, only admins can create advisories
  query fuzzer
  ...
2020-07-11 21:32:36 +04:00
Maxim Sabyanin
40f7ec71d3 add setting output_format_pretty_grid_charset
This setting allows to chose charset for printing grids (either UTF-8 or
ASCII).
2020-07-10 22:25:49 +03:00
Artem Zuikov
01b5c2663c
Delete injective functions inside uniq (#12337) 2020-07-10 13:42:41 +03:00
Alexander Tokmakov
77289146ab fix tests 2020-07-09 20:47:42 +03:00
Denis Glazachev
5a4762bb8a
Merge branch 'master' into ldap-per-user-authentication 2020-07-09 14:50:02 +04:00
Alexey Milovidov
f16afa4dee Fix typo in setting name 2020-07-08 14:49:44 +03:00