zhang2014
bf30aa5ff1
Code style
2020-12-09 16:50:40 +08:00
zhang2014
ef15b1f1fb
Better exception message for MaterializeMySQL
2020-12-09 16:46:54 +08:00
Ivan
0ba712a2d3
Merge branch 'master' into allow_atomic_database_inside_materialize_mysql
2020-12-08 16:45:51 +03:00
Winter Zhang
972cb41fae
Merge branch 'master' into fix/ISSUES-16835
2020-12-08 15:32:58 +08:00
Alexander Tokmakov
39532f7d9e
slightly better DDLWorker initialization and restarting
2020-12-03 21:14:27 +03:00
Alexander Tokmakov
a0ef3a113a
Merge branch 'master' into allow_atomic_database_inside_materialize_mysql
2020-12-02 18:29:02 +03:00
Alexander Tokmakov
1a4bd67736
fixes
2020-12-01 20:20:42 +03:00
Alexander Tokmakov
19c8399eb0
Merge branch 'master' into database_replicated
2020-12-01 17:33:07 +03:00
Vasily Nemkov
87945fb68b
Merge branch 'master' into HEAD
2020-11-30 23:25:57 +03:00
Alexander Tokmakov
ab197a49c8
better code, fixes
2020-11-30 23:12:43 +03:00
Alexander Tokmakov
f1a52a609b
separate DatabaseReplicatedDDLWorker
2020-11-27 17:04:03 +03:00
zhang2014
a74235397e
ISSUES-16835 try fix miss match header with MySQL SHOW statement
2020-11-24 23:31:43 +08:00
Alexander Tokmakov
e82c63e05c
fixes
2020-11-24 15:28:54 +03:00
Alexander Tokmakov
dce0bf8efc
Merge branch 'master' into allow_atomic_database_inside_materialize_mysql
2020-11-24 15:28:31 +03:00
Alexander Tokmakov
5ccf975a4a
Merge branch 'master' into database_replicated
2020-11-24 14:38:02 +03:00
Alexander Tokmakov
dad21ee684
maintain metadata in zk
2020-11-24 13:24:39 +03:00
taichong
a6c2a90756
modify integration test materialize mysql database
...
1. fix asan test err
2. reset pymysql conn if ping err
3. finish mysql & ck killed test
4. modify check_query
2020-11-23 17:55:07 +08:00
Alexey Milovidov
fbbf439338
Merge branch 'master' into Enmk-DateTime64_fixes_comparison
2020-11-23 05:46:17 +03:00
tavplubix
5cc9cb01cd
Merge pull request #16751 from amosbird/globalcontext
...
Make global_context consistent.
2020-11-22 18:46:17 +03:00
Nikolai Kochetov
bac1def5f9
Merge pull request #17134 from abyss7/tcp-port
...
Implement tcpPort() function for tests
2020-11-20 20:32:55 +03:00
Alexander Tokmakov
7ab4445e99
try another approach
2020-11-20 19:06:27 +03:00
tavplubix
3e335c1e95
Merge pull request #17091 from zhang2014/fix/binlog_checksum
...
Fix MaterializeMySQL SYNC failure when modify binlog_checksum
2020-11-20 13:25:14 +03:00
Amos Bird
1d9d586e20
Make global_context consistent.
2020-11-20 18:23:14 +08:00
Alexander Tokmakov
2283906a11
try support replica recovery
2020-11-19 13:34:45 +03:00
Ivan Lezhankin
fdd1c182ab
Merge remote-tracking branch 'upstream/master' into tcp-port
2020-11-18 16:22:00 +03:00
Ivan Lezhankin
f897f7c93f
Refactor IFunction to execute with const arguments
2020-11-17 16:24:45 +03:00
alexey-milovidov
b494b18748
Merge pull request #17108 from ClickHouse/ya-make-owners
...
Add "OWNER" to ya.make files.
2020-11-17 05:19:46 +03:00
Alexey Milovidov
24f4fa6edf
Follow Arcadia ya.make rules
2020-11-17 00:16:50 +03:00
Alexey Milovidov
3df04ce0c2
Follow Arcadia ya.make rules
2020-11-16 21:24:58 +03:00
Winter Zhang
f6a205d64b
Merge branch 'master' into fix/binlog_checksum
2020-11-16 21:53:22 +08:00
zhang2014
6ef93ac73c
Try fix MaterializeMySQL SYNC with modify binlog_checksum
2020-11-16 21:46:36 +08:00
Vasily Nemkov
63d168d34e
Fixed MySQL and DateTime64 integration.
...
Also updated other places, like type helpers/dispatchers where DateTime64
was implicitly supported before as Decimal64.
2020-11-16 09:02:41 +03:00
Alexander Tokmakov
b0262b3d06
better replica creation
2020-11-13 21:35:45 +03:00
Alexander Tokmakov
0731bfb7be
Merge branch 'master' into database_replicated
2020-11-12 21:04:18 +03:00
Alexander Tokmakov
2a6c0b9180
try reuse DDLWorker in DatabaseReplicated
2020-11-12 20:35:29 +03:00
taichong
010e12eb4b
Replace std::*stringstreams
2020-11-12 13:49:56 +08:00
TCeason
3912ed4965
Merge branch 'master' into add_sync_user_privs_exception
2020-11-12 09:34:08 +08:00
taichong
e2a9fe44b0
modify test error
2020-11-12 08:17:13 +08:00
taichong
5c1a01897a
Revise the code according to the review
2020-11-11 19:27:37 +08:00
taichong
d907afa77e
throw exception when mysql sync user privs error.
2020-11-11 19:27:37 +08:00
Alexander Tokmakov
b94cc5c4e5
remove more stringstreams
2020-11-10 21:22:26 +03:00
Alexander Tokmakov
62ff00ee8b
use WriteBuffer in formatAST(...)
2020-11-09 19:05:40 +03:00
tavplubix
6fb077c2f3
Merge pull request #16704 from TCeason/make_sync_ddl_execute_atomic
...
sync MySQL DDL atomicly
2020-11-09 13:47:02 +03:00
Alexey Milovidov
fd84d16387
Fix "server failed to start" error
2020-11-07 03:14:53 +03:00
taichong
9ce6c4dcb8
according to review modify code
2020-11-06 15:04:05 +08:00
Alexey Milovidov
b56486510f
Improve Arcadia
2020-11-05 12:55:01 +03:00
taichong
fb5e03ebaf
sync MySQL DDL atomicly
...
Now ClickHouse will write metadata and then execute DDL from MySQL.
But If ClickHouse is crashed and it just begin to execute DDL, we
restart the server and then the sync will may be stopped.
e.g.:
MySQL : create table foo.a(id int key); uuid1:1
ClickHouse : write uuid1:1 to .metadata -> server crashed;
Because of ClickHouse's metadata records: uuid1:1, if MySQL run a
query:`insert into foo.a values(1);` ClickHouse will throw a exception:
the table foo.a is not exist.
2020-11-05 17:01:14 +08:00
Alexander Tokmakov
d8ae9fcdb4
fixes, add shard name
2020-11-03 14:30:53 +03:00
Alexander Tokmakov
ac32809b6a
fix #16482
2020-11-02 19:40:39 +03:00
Maxim Akhmedov
3627fabfb9
Remove -g0 form Arcadia build settings.
2020-10-29 17:37:23 +03:00
alexey-milovidov
bf3acecf6f
Merge pull request #16032 from Avogar/mysql_bug
...
Don't touch MySQL database if it's unnecessary
2020-10-29 04:14:26 +03:00
tavplubix
22847613d1
Merge pull request #16437 from ClickHouse/addition_to_16127
...
Addition to #16127
2020-10-28 13:03:13 +03:00
alesapin
8a6be1602b
Merge pull request #16364 from ClickHouse/fix_uuid_mapping_exists
...
Minor improvements in DatabaseCatalog
2020-10-28 10:54:39 +03:00
Alexander Tokmakov
b5ccb5ed5b
review suggestions
2020-10-27 23:52:49 +03:00
Alexander Tokmakov
dba8c85ae4
do not wait while holding lock
2020-10-27 22:56:54 +03:00
Alexander Kuzmenkov
6509f1eb39
Merge branch 'master' into minumum
2020-10-27 21:38:23 +03:00
Mikhail Filimonov
41971e073a
Fix typos reported by codespell
2020-10-27 12:04:03 +01:00
Alexander Tokmakov
cd14f095ab
fix tests
2020-10-26 18:12:16 +03:00
Alexander Tokmakov
636da1318b
Merge branch 'master' into database_replicated
2020-10-26 15:00:43 +03:00
Alexey Milovidov
d5e277f080
Better exceptions rethrow
2020-10-26 06:35:57 +03:00
Alexander Tokmakov
f8f2d62d70
minor improvements in DatabaseCatalog
2020-10-25 20:27:21 +03:00
Alexander Tokmakov
478eb0b8a5
fix
2020-10-22 23:32:47 +03:00
Alexander Tokmakov
72dbb43235
Merge branch 'master' into fork-valbaturin-replication-db-engine
2020-10-20 19:14:54 +03:00
Azat Khuzhin
32c449c34f
Add IDatabaseTablesIterator::reset() interface
2020-10-19 00:16:10 +03:00
alesapin
0bb4480fee
Merge pull request #16031 from ClickHouse/database_atomic_patch
...
Minor fix for DatabaseAtomic
2020-10-16 10:08:04 +03:00
Alexander Tokmakov
2f9611f1ae
fix logical error with explicit UUIDs
2020-10-15 19:01:23 +03:00
Pavel Kruglov
ee8a9d2cf1
Don't touch MySQL database if it's unnecessary
2020-10-15 18:57:17 +03:00
Alexander Tokmakov
72b1339656
Revert "Revert "Write structure of table functions to metadata""
...
This reverts commit c65d1e5c70
.
2020-10-14 15:19:29 +03:00
tavplubix
c65d1e5c70
Revert "Write structure of table functions to metadata"
2020-10-14 13:59:29 +03:00
alexey-milovidov
f60ccb4edf
Merge pull request #14295 from ClickHouse/write_structure_of_table_functions
...
Write structure of table functions to metadata
2020-10-13 23:56:09 +03:00
Azat Khuzhin
d16adddb41
Fix drop of materialized view with inner table in Atomic database
...
Materialized view drop the inner table (if any) drop the drop() method,
and this will lead to essure recursive drop() from the drop worker
thread, which will hang:
3 std::__1::condition_variable::wait<> ()
4 DB::DatabaseCatalog::waitTableFinallyDropped (this=0x7ffff7831500, uuid=...) at ../src/Interpreters/DatabaseCatalog.cpp:828
5 DB::InterpreterDropQuery::executeToTable (this=this@entry=0x7fff16ff88a0, table_id_=..., query=...) at ../src/Interpreters/InterpreterDropQuery.cpp:135
6 DB::InterpreterDropQuery::execute (this=this@entry=0x7fff16ff88a0) at ../contrib/libcxx/include/string:1474
7 DB::executeDropQuery (kind=kind@entry=DB::ASTDropQuery::Drop, global_context=..., target_table_id=...) at ../src/Storages/StorageMaterializedView.cpp:156
8 DB::StorageMaterializedView::drop (this=0x7ffefc348f40) at ../src/Storages/StorageMaterializedView.cpp:169
9 DB::DatabaseCatalog::dropTableFinally (this=this@entry=0x7ffff7831500, table=...) at ../src/Interpreters/DatabaseCatalog.cpp:775
10 DB::DatabaseCatalog::dropTableDataTask (this=0x7ffff7831500) at ../src/Interpreters/DatabaseCatalog.cpp:745
Fix this by dropping the inner table just before scheduling job the the
drop worker thread.
2020-10-12 21:46:07 +03:00
Alexey Milovidov
269b6383f5
Check for #pragma once in headers
2020-10-10 21:37:02 +03:00
Alexander Tokmakov
6b2da861dc
Merge branch 'master' into write_structure_of_table_functions
2020-10-02 20:46:58 +03:00
Alexander Tokmakov
32776da69a
Merge branch 'master' into allow_atomic_database_inside_materialize_mysql
2020-10-02 20:09:37 +03:00
tavplubix
2f95609f98
Merge pull request #15448 from ClickHouse/allow_synchronous_drop_for_atomic_db
...
Allow synchronous DROP/DETACH TABLE for Atomic
2020-10-01 01:14:31 +03:00
tavplubix
c9eeb149fd
Merge pull request #15384 from zhang2014/fix/ISSUES-15365
...
ISSUES-15365 fix attach mysql database database
2020-09-30 11:27:15 +03:00
Alexander Tokmakov
e156e6115e
add setting
2020-09-30 01:30:34 +03:00
Alexander Tokmakov
5d19ed04f6
allow synchronous drop/detach table for Atomic
2020-09-29 16:47:08 +03:00
zhang2014
9e94c077e7
IESSUES-15365 try fix integration test
2020-09-29 10:39:30 +08:00
zhang2014
e5a6d06820
ISSUES-15365 try fix integration test failure
2020-09-28 21:15:02 +08:00
zhang2014
e40d23cfe5
ISSUES-15365 add ya make
2020-09-28 19:11:40 +08:00
zhang2014
d3047d0783
ISSUES-15365 fix attach mysql database failure
2020-09-28 18:02:30 +08:00
Alexander Tokmakov
b0d99217fb
Merge branch 'master' into write_structure_of_table_functions
2020-09-27 14:26:47 +03:00
Alexander Tokmakov
aa5e5013f2
Merge branch 'master' into allow_atomic_database_inside_materialize_mysql
2020-09-27 14:11:53 +03:00
Alexander Tokmakov
34addcf61f
add review suggestions
2020-09-26 22:18:28 +03:00
alexey-milovidov
e29c4c3cc4
Merge pull request #15024 from ClickHouse/fix_renameat2_einval_on_macos
...
Fix EINVAL in renameat2 on MacOS
2020-09-21 21:08:17 +03:00
tavplubix
7f629c8185
Update DatabaseMemory.cpp
2020-09-21 14:12:45 +03:00
alesapin
5ffee8808a
Alter remove column properties and TTLs ( #14742 )
2020-09-20 16:27:33 +03:00
Alexander Tokmakov
46aa307d0a
fix EINVAL in renameat2 on MacOS
2020-09-19 17:19:06 +03:00
tavplubix
6e0bdaf46d
Merge pull request #14535 from zhang2014/fix/datetime
...
ISSUES-4006 support decimal data type for MaterializedMySQL
2020-09-19 14:05:32 +03:00
Alexander Tokmakov
1ca9a92b21
Merge branch 'master' into write_structure_of_table_functions
2020-09-18 21:09:23 +03:00
tavplubix
0597ad3150
fix typo
2020-09-17 21:47:21 +03:00
Alexander Tokmakov
1c37ac7c9d
fix
2020-09-17 21:19:02 +03:00
Alexander Tokmakov
41e99cf261
Merge branch 'master' into allow_atomic_database_inside_materialize_mysql
2020-09-17 20:28:50 +03:00
zhang2014
64032e22a2
Merge branch 'master' into fix/datetime
2020-09-18 00:28:09 +08:00
zhang2014
c5b56c24f8
ISSUES-14894 fix MaterializeMySQL temp metadata file exists
2020-09-17 14:44:05 +08:00
Alexander Tokmakov
0ecf8e595f
cleanup code, add test
2020-09-15 16:41:53 +03:00
Artem Zuikov
51ba12c2c3
Try speedup build ( #14809 )
2020-09-15 12:55:57 +03:00
Alexander Tokmakov
3671c91c37
Merge branch 'master' into allow_atomic_database_inside_materialize_mysql
2020-09-15 12:43:01 +03:00
Alexander Tokmakov
a812f7eb75
allow using Atomic database inside MaterializeMySQL
2020-09-14 22:25:02 +03:00
BohuTANG
00b8d91eb8
Fix mysql replication TableMapEvent optional metadata ignore
2020-09-10 19:46:59 +08:00
zhang2014
094897fe69
Merge branch 'master' into fix/datetime
2020-09-09 23:37:54 +08:00
Alexander Tokmakov
d278d849e4
Merge branch 'master' into write_structure_of_table_functions
2020-09-09 17:12:35 +03:00
Vasily Nemkov
3973a17530
MySql datatypes dateTime64 and decimal ( #11512 )
2020-09-09 15:18:02 +03:00
Winter Zhang
18b4c5997d
Merge branch 'master' into fix/datetime
2020-09-08 11:32:48 +08:00
Alexey Milovidov
e3924b8057
Fix "Arcadia"
2020-09-08 01:14:13 +03:00
zhang2014
b7e9d5e72d
ISSUES-4006 support decimal for MaterializedMySQL engine
2020-09-07 17:43:25 +08:00
Alexander Tokmakov
b840d741d0
Merge branch 'master' into write_structure_of_table_functions
2020-09-04 13:00:07 +03:00
zhang2014
dd0feeeaa1
ISSUES-4006 support datetime with precision
2020-09-03 11:03:28 +08:00
Alexey Milovidov
96038e9d54
Fix for Lazy database
2020-09-03 04:06:12 +03:00
Alexander Tokmakov
41dd393824
fixes
2020-09-01 20:55:35 +03:00
Alexander Tokmakov
56695727b2
Merge branch 'master' into write_structure_of_table_functions
2020-09-01 20:15:13 +03:00
Alexander Tokmakov
3a9779adb4
slightly better code
2020-09-01 17:41:49 +03:00
alesapin
a0b4cc78d6
Throw exception on alter for storages created from table functions
2020-09-01 10:26:31 +03:00
zhang2014
4182596961
ISSUES-14231 try fix wrong lexer
2020-08-29 12:28:04 +08:00
alesapin
c1ca09653e
Update custom parts of storage AST only if it has extended definition
2020-08-28 14:30:53 +03:00
alesapin
0896b49533
Small fixes
2020-08-28 13:18:56 +03:00
Amos Bird
078b14610d
ALTER MODIFY SAMPLE BY
2020-08-27 22:31:30 +08:00
Alexander Tokmakov
969940b4c9
write table tructure for table function remote(...)
2020-08-26 23:55:40 +03:00
tavplubix
cff92c8ad3
Merge pull request #13820 from BohuTANG/mysql_replica_gtid_issue_4006
...
ISSUES-4006 support MySQL GTID based replication #4006
2020-08-26 15:02:53 +03:00
tavplubix
3b8ac01ed0
Merge pull request #13756 from ClickHouse/test-drop-database-race
...
Fix race condition in DROP DATABASE
2020-08-19 13:27:50 +03:00
Alexander Tokmakov
e686616756
add exclusive DDLGuard for database
2020-08-18 18:15:27 +03:00
BohuTANG
8c9236fefd
ISSUES-4006 adapted GTID replication to Materialize MySQL
2020-08-17 22:12:41 +08:00
BohuTANG
adc6cce96e
ISSUES-4006 fetch executed_gtid_set from replication position #4006
2020-08-17 15:38:09 +08:00
tavplubix
18ef911fe8
Merge pull request #13672 from zhang2014/refactor/materialize_mysql_database
...
ISSUES-4006 split mysql protocol to multiple packets
2020-08-16 13:55:11 +03:00
zhang2014
fe49bd3414
Merge branch 'master' of github.com:yandex/ClickHouse into refactor/materialize_mysql_database
2020-08-15 16:12:46 +08:00
Alexey Milovidov
52c3857225
Fix server restart after stress test
2020-08-15 06:10:57 +03:00
Alexander Tokmakov
0f1c4bc9c4
attach all system tables
2020-08-13 20:09:40 +03:00
zhang2014
96bd3ac34b
ISSUES-4006 split mysql protocol
2020-08-13 20:41:36 +08:00
zhang2014
34f4c8972e
ISSUES-4006 split replication packets
2020-08-13 20:07:02 +08:00
zhang2014
a8d3b5f65d
ISSUES-4006 better exception message
2020-08-13 10:14:59 +08:00
tavplubix
4aff48dc3f
Merge pull request #10851 from zhang2014/feature/materialize_mysql_database
...
ISSUES-4006 support MaterializeMySQL database engine
2020-08-12 15:59:28 +03:00
zhang2014
2311cda334
ISSUES-4006 convert _sign & _version to materialized column
2020-08-10 22:32:05 +08:00
Alexey Milovidov
0c15f3b6c8
Allow server to startup if there are leftovers from unsuccessfull database creations
2020-08-10 05:58:08 +03:00
zhang2014
933f287db4
ISSUES-4006 resolve review comment & support alter renmae command
2020-08-09 20:10:30 +08:00
zhang2014
6fca8ad7df
ISSUES-4006 fix segfault on ClickHouse shutdown when MySQL is not available
2020-08-07 16:49:27 +08:00
zhang2014
d6bba8cbbb
ISSUES-4006 add settings for allows_query_when_mysql_lost & move dump event to logger
2020-08-07 14:12:27 +08:00
zhang2014
bd21f8e6b9
ISSUES-4006 fix conflicts commit when merge
2020-08-07 12:55:45 +08:00
zhang2014
e496225641
ISSUES-4006 try fix build failure & review comment
2020-08-07 12:53:33 +08:00
zhang2014
a3bc18bed2
ISSUES-4006 try resolve review comment
2020-08-06 12:03:27 +08:00
Alexey Milovidov
d91471ea00
Merge branch 'master' into stack-frams-size-limit
2020-08-04 15:28:47 +03:00
zhang2014
34f7fac76c
ISSUES-4006 try fix test failure
2020-08-04 12:22:12 +08:00
Alexander Tokmakov
cf78a1f8fc
try fix build
2020-08-04 10:31:27 +08:00
zhang2014
7ea2eee98a
ISSUES-4006 add some check & add comment
2020-08-04 10:31:27 +08:00
zhang2014
c173bd391f
ISSUES-4006 try fix build & test failure
2020-08-04 10:31:27 +08:00
zhang2014
6b452cf83d
ISSUES-4006 try fix build failure & fix float 32 parser
2020-08-04 10:31:27 +08:00
zhang2014
c0db408c38
ISSUES-4006 try fix build failure
2020-08-04 10:31:27 +08:00
zhang2014
b76f218d90
ISSUES-4006 add mysql dml test
2020-08-04 10:31:27 +08:00
zhang2014
9996166860
ISSUES-4006 try fix check style
2020-08-04 10:31:27 +08:00
zhang2014
bd65a8f213
ISSUES-4006 try fix build failure
2020-08-04 10:31:27 +08:00
zhang2014
9d8234afd7
ISSUES-4006 try fix integration test
2020-08-04 10:31:27 +08:00
zhang2014
c5946f7697
ISSUES-4006 add mysql 8.0 integration test
2020-08-04 10:31:27 +08:00
zhang2014
74f354d840
ISSUES-4006 add some check before create materialize mysql database
2020-08-04 10:31:27 +08:00
zhang2014
95b8afb8eb
ISSUES-4006 try fix unit test failure
2020-08-04 10:31:26 +08:00
zhang2014
e471f805b5
ISSUES-4006 try fix build failure & update integration test
2020-08-04 10:31:26 +08:00
zhang2014
1c17878f31
ISSUES-4006 try fix build failure
2020-08-04 10:31:26 +08:00
zhang2014
1930b8f584
ISSUES-4006 support drop materialize mysql database engine
2020-08-04 10:31:26 +08:00
zhang2014
eace0153bd
ISSUES-4006 fix test failure
2020-08-04 10:31:26 +08:00
zhang2014
8f28df3514
ISSUES-4006 rename locality_data to MaterializeMySQL
2020-08-04 10:31:26 +08:00
zhang2014
cee16292a6
ISSUES-4006 fix restart failure
2020-08-04 10:31:26 +08:00
zhang2014
094ce895da
ISSUES-4006 fix test failure
2020-08-04 10:31:26 +08:00
zhang2014
035760df9d
ISSUES-4006 refactor for external ddl
2020-08-04 10:31:26 +08:00
zhang2014
6562597064
ISSUES-4006 refactor interpreter
2020-08-04 10:31:26 +08:00
zhang2014
1583f67681
ISSUES-4006 remove unused code
2020-08-04 10:31:26 +08:00
zhang2014
54c3db0567
ISSUES-4006 some refactor for query convert
2020-08-04 10:31:26 +08:00
zhang2014
5fb92359d2
ISSUES-4006 some refactor for query convert
2020-08-04 10:31:26 +08:00
zhang2014
3afffaf303
ISSUES-4006 rename sign and version column
2020-08-04 10:31:26 +08:00
zhang2014
101a13b5c3
ISSUES-4006 remove unused code
2020-08-04 10:31:26 +08:00
zhang2014
a9e1794bd3
ISSUES-4006 filter sign = -1 rows
2020-08-04 10:31:26 +08:00
zhang2014
9324c0ee49
ISSUES-4006 fix crash when dump data
2020-08-04 10:31:26 +08:00
zhang2014
1df8bfe4fb
ISSUES-4006 fix build failure after refactor
2020-08-04 10:31:25 +08:00
zhang2014
4a99ca0d80
ISSUES-4006 refactor
2020-08-04 10:31:25 +08:00
zhang2014
0f75b2d0f0
ISSUES-4006 fix buidl failure
2020-08-04 10:31:25 +08:00
zhang2014
0336a4ad58
ISSUES-4006 suport synchronous MySQL incremental data[part 2]
2020-08-04 10:31:23 +08:00
zhang2014
0c52d425ba
ISSUES-4006 suport synchronous MySQL incremental data
2020-08-04 10:29:54 +08:00
zhang2014
7203c6e186
ISSUES-4006 unlock table on exception
2020-08-04 10:29:54 +08:00
zhang2014
86c6be4cd9
ISSUES-4006 fix create query convert
2020-08-04 10:29:52 +08:00
zhang2014
bd18c1cbf8
ISSUES-4006 support dump all mysql data when create database
2020-08-04 10:27:57 +08:00
zhang2014
5d569f56a7
ISSUES-4006 support convert mysql create to clickhouse create
2020-08-04 10:26:23 +08:00
zhang2014
c53a48fe01
ISSUES-4006 support parse MySQL create query
2020-08-04 10:26:23 +08:00
Alexander Tokmakov
5b92f43f12
Merge branch 'master' into database_atomic_improvements
2020-08-03 14:35:40 +03:00
Alexey Milovidov
0fd7af8a63
Merge branch 'master' into stack-frams-size-limit
2020-08-03 00:06:00 +03:00
Alexey Milovidov
41111d1e57
Merge branch 'master' into stack-frams-size-limit
2020-08-02 19:18:33 +03:00
Alexey Milovidov
6f690b7c0d
Normalize ya.make files, fix "Arcadia" build
2020-08-02 16:57:38 +03:00
Vitaly Baranov
668653600c
Use SettingMaxThreads only in Settings, call getNumberOfPhysicalCPUCores() instead of SettingMaxThreads::getAuto().
2020-07-31 19:11:27 +03:00
Vitaly Baranov
30b34e6a15
Use SettingSeconds only in Settings, use std::chrono::seconds in other places.
2020-07-31 19:11:27 +03:00
Alexey Milovidov
50bbfc848d
Merge branch 'master' into stack-frams-size-limit
2020-07-21 14:45:15 +03:00
Alexander Tokmakov
cc25355989
fix
2020-07-18 19:33:39 +03:00
Alexander Tokmakov
c27de9b424
fixes
2020-07-17 16:11:44 +03:00
Alexander Tokmakov
ebf98ba006
implement reneme dictionary query
2020-07-17 00:41:26 +03:00
Alexander Tokmakov
d10b4c504d
rename database with dictionaries
2020-07-16 17:25:39 +03:00
Alexander Tokmakov
f6949b2f47
use dictionary ids
2020-07-15 22:25:31 +03:00
Alexander Tokmakov
31e62e713e
write uuid for ddl dictionaries
2020-07-14 00:21:01 +03:00
Alexander Tokmakov
15b395da51
fixes
2020-07-13 17:24:00 +03:00
Alexander Tokmakov
445acd0294
Merge branch 'master' into database_atomic_improvements
2020-07-09 16:02:54 +03:00
Alexander Tokmakov
9c4efa1f36
fix, add test
2020-07-09 01:50:15 +03:00
Alexander Tokmakov
7a5d532c7b
implement rename database for atomic
2020-07-07 15:11:58 +03:00
Alexander Tokmakov
d1be5ec641
fix symlinks, add short syntax of attach database
2020-07-06 16:41:43 +03:00
Vitaly Baranov
99e9b15e00
Make code clearer: use enum instead of bool internal
.
2020-07-05 17:14:29 +03:00
Val
e591fe5014
database replicated feedback mechanism prototype
2020-07-04 19:32:23 +03:00
Vitaly Baranov
ab343132de
Fix handling dependency of table with ENGINE=Dictionary on dictionary.
2020-07-03 22:05:53 +03:00
Alexander Tokmakov
383c583bdd
add uuid to atomic databases
2020-07-02 23:39:31 +03:00
alexey-milovidov
948af0bfc5
Merge pull request #12045 from ClickHouse/fix_loading_of_tables
...
Parse metadata in parallel when loading tables
2020-06-30 21:16:40 +03:00
Alexander Tokmakov
987e64acfe
parse metadata in parallel when loading tables
2020-06-30 03:12:16 +03:00
Val
8273248c4e
add log_name_to_exec to dbreplicated
2020-06-28 18:43:30 +03:00
Alexey Milovidov
1462a66d1e
Fix typos
2020-06-27 22:05:00 +03:00
Val
e23c7a313e
address pr comments
2020-06-27 17:04:12 +03:00
Val
9635ea64be
Add desc of propose idatabase method
2020-06-27 17:04:11 +03:00
Val
d293e002a7
address pr comments
2020-06-27 17:04:11 +03:00
Val
16e50e33d7
fix typo
2020-06-27 17:04:11 +03:00
Val
67588edcf5
clean up db replicated files and add more tests
2020-06-27 17:04:11 +03:00
Val
82f5281cfe
remove redundant includes
2020-06-27 17:04:11 +03:00
Val
4fc4b1d195
db replicated minor enhancements
2020-06-27 17:02:06 +03:00
Val
f928c897cf
change replication algorithm, remove zk lock
...
In this version of the databaseReplicated sequential persistent zk nodes
are used to order DDL queries. Db replicated ddl queries are executed
in the backgrould pool no matter whether it's proposed by the same
replica or not.
2020-06-27 17:02:03 +03:00
Val
469f9738df
refactor save state in db replicated
2020-06-27 17:01:20 +03:00
Val
a0af67b636
Add one more test for db replicated and fix related bug
2020-06-27 17:01:20 +03:00
Val
0e9f516738
add comment for replicated db class
2020-06-27 17:01:20 +03:00
Val
31910e9bf1
Use ClientInf::QueryKind to distinguish replicated db log queries
2020-06-27 17:01:18 +03:00
Val
cbcd1bea0e
provide better comments and information
2020-06-27 17:00:44 +03:00
Val
4921dc6dab
db replicated refactoring
2020-06-27 16:59:11 +03:00
Val
5e076b464e
add replicated db snapshot, integration test, repl alter queries, etc
...
add an option to create replicated tables within replicated db without specifying zk path and replica id
add replicated sch pool
disable replication of alter queries for replicated tables in replicated dbs
snapshot prototype. amend of replicated db workflow
add prototype of integration tests for replicated db
2020-06-27 16:58:15 +03:00
Val
f103e24a09
make db replicated inherited from atomic
2020-06-27 16:52:35 +03:00
Val
d7a354b24d
create query fix for replicated dbs
2020-06-27 16:51:47 +03:00
Val
d61259cd7b
ddl replication works
2020-06-27 16:51:47 +03:00
Val
5eea58039c
fix not initialized last entry in zk
2020-06-27 16:51:47 +03:00
Val
0a860c0c2b
log based replicated
2020-06-27 16:51:36 +03:00
Val
319256ef4f
an attempt to replicated create query from create query
2020-06-27 16:49:40 +03:00
Val
0a4c1783a1
Make drop work by fixing namespace bug
...
data dir wasn't set right. now it's fixed.
add non-replicated table to test sql
2020-06-27 16:49:40 +03:00
Val
8b0366ff4f
an attempt to make something meaningful
2020-06-27 16:49:40 +03:00
Val
0d392bbb34
fix after rebase
2020-06-27 16:49:39 +03:00
Val
d4210d04c1
databasereplicated constructor scratch
2020-06-27 16:49:39 +03:00
tavplubix
dfdfc69df1
Merge pull request #11900 from bharatnc/ncb/fix-file-path
...
fix double slashed paths in DatabaseOrdinary by switching to std::filesystem::path
2020-06-26 15:05:15 +03:00
bharatnc
76938b40a4
use std::filesystem::path
2020-06-25 18:30:44 -07:00
Bharat Nallan
325a515e90
remove clang-format tag comments
2020-06-24 12:01:12 -07:00
Bharat Nallan
1244ca5627
fix style check - clang format for lambdas
2020-06-24 07:34:32 -07:00
bharatnc
4f10873c22
cleanup few unused headers
...
The following files had some unused headers and caught my eyes, so
cleaning them up:
```bash
programs/obfuscator/Obfuscator.cpp
src/Databases/DatabaseAtomic.cpp
```
2020-06-23 22:08:05 -07:00
Bharat Nallan
ea40e7b403
construct path using boost::filesystem::path
2020-06-23 18:43:36 -07:00
Bharat Nallan
6a9f3d768a
clang format file
2020-06-23 18:31:25 -07:00
Bharat Nallan
ce391c84c5
remove unused imports
2020-06-23 18:11:06 -07:00
alesapin
f262c4f652
Better comments
2020-06-22 12:49:21 +03:00
alesapin
d79982f497
Better locks in Storages
2020-06-18 19:10:47 +03:00
alesapin
dffdece350
getColumns in StorageInMemoryMetadta (only compilable)
2020-06-17 19:39:58 +03:00
alesapin
a39d010f94
Merge branch 'master' into consistent_metadata4
2020-06-11 18:47:41 +03:00
alexey-milovidov
89df9915bb
Merge pull request #11592 from ClickHouse/replicated-merge-tree-create-drop-race-garbage
...
Fix race conditions in CREATE/DROP of different replicas of ReplicatedMergeTree
2020-06-11 17:11:38 +03:00
Alexey Milovidov
b72a095e99
Fix race conditions in CREATE/DROP of different replicas of ReplicatedMergeTree
2020-06-11 06:24:52 +03:00
Alexander Tokmakov
9166ddea41
fix segfault in show create table
2020-06-10 15:53:12 +03:00
Alexey Milovidov
475af33319
Avoid too large stack frames
2020-06-08 20:35:45 +03:00
alesapin
ac67d0485c
Merge branch 'master' into consistent_metadata4
2020-06-08 15:06:51 +03:00
alesapin
abaf47f0cd
Make metadata single structure
2020-06-05 20:29:40 +03:00
Alexander Kuzmenkov
435f53e05a
Improve error messages
...
Also support fmt for exception messages, the same way we use it in
logging macros.
2020-06-04 20:50:29 +03:00
Alexander Kuzmenkov
c7d9094a7a
Merge pull request #11259 from ClickHouse/consistent_metadata3
...
More consistent metadata for secondary indices
2020-06-03 12:23:21 +03:00
alesapin
1ab3047201
Merge branch 'master' into consistent_metadata3
2020-06-02 10:37:12 +03:00
Alexey Milovidov
a6bf4b5d70
Fix error with Lazy database
2020-06-02 05:06:16 +03:00
alesapin
b49be4c7f2
Better names
2020-06-01 15:11:23 +03:00
Alexander Kuzmenkov
ca3fb27b09
Report dictionary name on dictionary load errors.
2020-06-01 14:08:14 +03:00
Alexey Milovidov
25f941020b
Remove namespace pollution
2020-05-31 00:57:37 +03:00
Alexander Tokmakov
3cff070f89
add context to IDatabase methods
2020-05-28 23:10:45 +03:00
Alexey Milovidov
7e1813825b
Return old names of macros
2020-05-24 01:24:01 +03:00
Alexey Milovidov
7c0c328a35
Progress on task
2020-05-24 00:05:47 +03:00
Alexey Milovidov
d5b7883451
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_[^\_(]+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_[^\_(]+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5{}\7{}\9", \4, \6, \8);/'
2020-05-23 22:41:08 +03:00
Alexey Milovidov
7e2fb9ad65
Apply all transformations again
2020-05-23 22:38:30 +03:00
Alexey Milovidov
29762240de
Remove duplicate whitespaces (preparation)
2020-05-23 22:31:54 +03:00
Alexey Milovidov
1f13515a65
Make all LOG in single line (preparation)
2020-05-23 21:31:37 +03:00
Alexey Milovidov
9d24908e53
Progress on task
2020-05-23 20:52:11 +03:00
Alexey Milovidov
533f86278a
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5{}\7", \4, \6);/'
2020-05-23 20:00:41 +03:00
Alexey Milovidov
e391b77d81
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5", \4);/'
2020-05-23 19:56:05 +03:00
Alexey Milovidov
ee4ffbc332
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}", \4);/'
2020-05-23 19:47:56 +03:00
Alexey Milovidov
8d2e80a5e2
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+"\)' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+, "[^"]+")\)/\1_FORMATTED(\2)/'
2020-05-23 19:42:39 +03:00
alexey-milovidov
655b8e1903
Merge pull request #11021 from ClickHouse/fix_10557
...
Remove data on DROP DATABASE for DatabaseMemory
2020-05-21 20:17:46 +03:00
Azat Khuzhin
d93b9a57f6
Forward declaration for Context as much as possible.
...
Now after changing Context.h 488 modules will be recompiled instead of 582.
2020-05-21 01:53:18 +03:00
Alexander Tokmakov
6af9c78476
remove data on DROP DATABASE
2020-05-18 16:51:01 +03:00
alexey-milovidov
6f1d522b6a
Merge pull request #10980 from azat/database-atomic-fixes
...
Database atomic fixes
2020-05-17 23:25:56 +03:00
Azat Khuzhin
fb6b19d57a
Fix symlinking data directory for Atomic database
2020-05-17 17:14:51 +03:00
Alexey Milovidov
90cd5d8a3c
Remove unused header file
2020-05-17 13:27:13 +03:00
Alexander Tokmakov
791ccd8b05
never throw from destructor
2020-05-17 04:01:26 +03:00
Alexey Milovidov
99c18c5a09
Check for suspicious codecs #4966
2020-05-04 03:11:49 +03:00
Vitaly Baranov
dd34cd73e2
Move initialization of DatabaseWithDictionaries to constructor.
2020-04-30 20:22:20 +03:00
Alexander Tokmakov
04d4130b0d
update yamake
2020-04-24 20:14:10 +03:00
Alexander Tokmakov
15e7ce0053
fixes
2020-04-23 21:00:43 +03:00
Alexander Tokmakov
f413061e0d
remove Context from some IDatabase methods
2020-04-23 19:51:48 +03:00
Alexander Tokmakov
04d6b59ac0
Merge branch 'master' into database_atomic
2020-04-23 17:31:37 +03:00
alexey-milovidov
77969d11a5
Merge pull request #10442 from zhang2014/fix/create_database_failure
...
Not remove metadata directory when attach database fails
2020-04-23 01:07:13 +03:00
Alexander Tokmakov
1833ac7f16
fixes
2020-04-22 23:43:10 +03:00
alexey-milovidov
9e14603ae5
Update DatabaseFactory.cpp
2020-04-22 22:37:30 +03:00
zhang2014
a622208284
Not remove metadata directory when attach database fails
2020-04-23 00:03:58 +08:00
Alexander Tokmakov
fefbbd37df
Merge branch 'master' into database_atomic
2020-04-22 17:02:30 +03:00
Alexey Milovidov
be22a4b94e
Checkpoint
2020-04-22 08:39:31 +03:00
Azat Khuzhin
9173895f85
Fix dictionary name (RELOAD and system.dictionaries) after DETACH/ATTACH
...
After DETACH/ATTACH (or at server startup) the following will be broken:
- SYSTEM RELOAD DICTIONARY db_name.dict_name
- system.dictionaries will not have database for those dictionaries
The problem is that after DETACH/ATTACH the dictionary information is
obtained from metadata/$db/$dict.sql, but it does not have database
name.
Fix this by passing database name to the getDictionaryConfigurationFromAST().
Introduced-in: #10234
2020-04-21 21:03:12 +03:00
Alexander Tokmakov
b29bddac12
Merge branch 'master' into database_atomic
2020-04-20 14:09:09 +03:00
Vitaly Baranov
d62345bbaa
Show information about not loaded dictionaries in system.columns, system.tables
...
and in "SHOW TABLES" executed in any database with the "Dictionary" engine.
2020-04-18 12:50:54 +03:00
alexey-milovidov
17e7d4d88a
Merge pull request #10307 from abyss7/arcadia-4
...
Changes for auto-sync with Arcadia
2020-04-17 05:08:34 +03:00
Ivan Lezhankin
e230632645
Changes required for auto-sync with Arcadia
2020-04-16 15:31:57 +03:00
Alexey Milovidov
cdeda4ab91
Fix usage of max_parser_depth setting; remove harmful default function arguments
2020-04-16 04:06:10 +03:00
Alexander Tokmakov
d1024e76bd
fix
2020-04-13 18:46:36 +03:00
Alexander Tokmakov
5e6d4b9449
Merge branch 'master' into database_atomic
2020-04-12 16:35:44 +03:00
alexey-milovidov
a4969d89f9
Merge pull request #10164 from azat/system.tables-superfluous-dict-reload
...
Avoid superfluous dictionaries load
2020-04-11 23:05:56 +03:00
Alexander Tokmakov
8b6c836720
fix
2020-04-11 18:38:41 +03:00
Vitaly Baranov
18fbd968ba
Merge pull request #10165 from azat/drop-dictionary-as-table
...
Do not break DROP DICTIONARY with DROP TABLE
2020-04-11 14:49:41 +03:00
Azat Khuzhin
55a143d1a5
Avoid superfluous dictionaries load (system.tables, SHOW CREATE TABLE)
...
This patch avoids loading dictionaries for:
- SELECT * FROM system.tables (used by clickhouse-client for completion)
- SHOW CREATE TABLE some_dict
But the dictionary will still be loaded on:
- SHOW CREATE TABLE some_dict (from the database with Dictionary engine)
2020-04-11 13:26:41 +03:00
Alexander Tokmakov
f0edb65e33
add test
2020-04-11 02:02:15 +03:00
Azat Khuzhin
5b3c635200
Do not break DROP DICTIONARY after DROP TABLE executed on dictionary
2020-04-10 21:10:32 +03:00
Alexander Tokmakov
033d7f9b32
Merge branch 'master' into database_atomic
2020-04-10 17:12:09 +03:00
Alexander Kazakov
497df3086f
Merge branch 'master' into timed_rwlock
...
Change-Id: I620bfde2121ff013773b001d514b40b1e796a58b
2020-04-10 11:38:20 +03:00
Alexander Tokmakov
50decc755d
fix rename materialized view
2020-04-10 04:35:37 +03:00
Alexander Tokmakov
03ed9d59b0
add symlinks
2020-04-10 03:08:43 +03:00
Alexander Kazakov
26dd6140b2
Added new config settings to control timeouts
...
* "lock_acquire_timeout" controls for how long a query will continue to
acquire each lock on its argument tables
* "lock_acquire_timeout_for_background_operations" is a per-table
setting for storages of *MergeTree family
2020-04-09 21:10:27 +03:00
zhang2014
9eb96b87db
ISSUES-10056 reused evaluateConstantExpressionOrIdentifierAsLiteral
2020-04-09 01:31:28 +08:00
zhang2014
9ed708b902
ISSUES-10056 add some check and support identifier argument for MySQL Database Engine
2020-04-09 01:31:27 +08:00
Alexander Tokmakov
135197aa75
fixes
2020-04-08 04:02:00 +03:00
Alexander Tokmakov
4c48b7dd80
better rename
2020-04-07 18:31:33 +03:00
Alexander Tokmakov
a2101c9b1c
better code
2020-04-07 02:22:44 +03:00
Alexander Tokmakov
08bae4668d
Merge branch 'master' into database_atomic
2020-04-06 16:18:07 +03:00
Ivan Lezhankin
06446b4f08
dbms/ → src/
2020-04-03 18:14:31 +03:00