Commit Graph

286 Commits

Author SHA1 Message Date
alesapin
a28cf1ed98 Remove wrong option 2018-07-27 20:25:51 +03:00
alexey-milovidov
1140a07b58
Merge pull request #2729 from amosbird/master
Use docker exec to operate on kafka.
2018-07-26 21:34:04 +03:00
alexey-milovidov
24b0be2cf0
Merge pull request #2727 from alesapin/CLICKHOUSE-3832
CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol
2018-07-26 20:50:09 +03:00
Amos Bird
54a08ed018 Use docker exec to operate on kafka. 2018-07-27 01:24:35 +08:00
Alexey Zatelepin
02946d2bc1 Revert "Set up dns server for kafka integration tests."
This reverts commit 1c75c19106.
2018-07-26 18:52:50 +03:00
alesapin
6abbfbce87 CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol 2018-07-26 18:10:57 +03:00
Alexey Milovidov
ec202a7fd0 Allow to start cluster with Kafka without pytest #2725 2018-07-26 17:40:33 +03:00
Amos Bird
1c75c19106 Set up dns server for kafka integration tests. 2018-07-26 12:53:48 +08:00
Amos Bird
c9a8759e08
Update README.md
kafka integration test uses this package https://github.com/dpkp/kafka-python
2018-07-26 00:34:40 +08:00
Alexey Milovidov
9079bdad4e Updated README #2701 2018-07-25 19:27:38 +03:00
Alexey Milovidov
b4556cc598 ~/work/ClickHouse/dbms/tests/integration$ find . -name '*.py' | xargs sed -i -r -e 's/macroses/macros/g' # [#CLICKHOUSE-2] 2018-07-25 19:00:51 +03:00
Amos Bird
0965f991b3 Add row_delimiter argument to StorageKafka.
There are common cases where a message doesn't end with a row delimiter.
This patch allows specifying a row_delimiter char to compensate that.

https://github.com/yandex/ClickHouse/issues/2298
2018-07-25 18:54:01 +03:00
Amos Bird
15cc1cf91b Fix integration test.
without specifying errorlog, I got

```
E               Logging trace to /var/log/clickhouse-server/clickhouse-server.log
E               Logging errors to clickhouse-server.err.log
E               Poco::Exception. Code: 1000, e.code() = 13, e.displayText() = Access to file denied: /clickhouse-server.err.log, e.what() = Access to file denied
```
2018-07-25 12:29:16 +03:00
zhang2014
7e87fa8e18 ISSUES-2688 support on cluster for kill & optimize query 2018-07-24 22:07:13 +03:00
Alexey Milovidov
52b284a67f Updated README for integration tests [#CLICKHOUSE-2] 2018-07-16 07:22:16 +03:00
Alexey Milovidov
e3b3c9f81b Added test for chroot in ZK [#MDBSUPPORT-204] 2018-07-10 19:14:27 +03:00
Alexey Zatelepin
88951cac62 clearer error message in test 2018-07-05 16:29:22 +03:00
Alexey Zatelepin
3cbced0d2a add integration test for mutations of Replicated tables [#CLICKHOUSE-3747] 2018-06-29 16:46:28 +03:00
Alexey Zatelepin
7ce4ebf1e1 fix test (disable random component in CleanupThread sleep period) 2018-06-22 18:53:59 +03:00
proller
c1904d3c55
Build and test fixes (#2470) 2018-06-05 20:43:10 +03:00
Alexey Zatelepin
af06ca5d3c Merge branch 'master' into replicated-mergetree-mutations 2018-06-01 16:21:14 +03:00
Alexey Zatelepin
8da32835d1 add needed file 2018-05-31 21:41:39 +03:00
Alexey Zatelepin
c9bb986330 Merge branch 'master' into replicated-mergetree-mutations
Conflicts:
	dbms/src/Storages/MergeTree/AbandonableLockInZooKeeper.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-05-31 18:52:42 +03:00
Babacar Diassé
3d518e48b9 NULL check to allow insertion in distributed tables with Materialized views 2018-05-31 17:21:35 +03:00
Alexey Zatelepin
f6c72f8e56 Merge branch 'master' into replicated-mergetree-mutations
Conflicts:
	dbms/src/Common/ActionBlocker.h
	dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
	dbms/src/Storages/MergeTree/ActiveDataPartSet.h
	dbms/src/Storages/MergeTree/MergeTreeData.h
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
	dbms/src/Storages/StorageMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.h
2018-05-28 18:37:30 +03:00
Alexey Zatelepin
2ab50c1f13 add test with inserts into Replicated tables from multiple threads [#CLICKHOUSE-3732] 2018-05-25 23:04:04 +03:00
proller
68ba523b23 Compile and doc fixes (#2410)
* Try fix travis

* fix

* Fix clickhouse-local shared-split link

* fix

* fix

* fix

* Build fixes

* Fix tinfo

* fix

* tinfo -> termcap

* termcap fix

* Better llvm version detect

* fix

* Debian postinst fix
Tests: use /usr/local if exists

* Compile and doc fixes

* fix

* fix

* fix

* macos fixes

* fix

* wip

* Update demangle.h

* Update demangle.cpp
2018-05-25 21:13:48 +03:00
Vitaliy Lyudvichenko
412c154045 Better configs for an integration test. [#CLICKHOUSE-2] 2018-05-15 21:25:54 +03:00
sundy-li
04c734d785 delete unused space 2018-05-15 03:02:59 +03:00
sundy-li
8a5990fc74 add integration test_storage_mysql 2018-05-15 03:02:59 +03:00
Vitaliy Lyudvichenko
e8b94b89e9 Removed dbg output, fixed test. [#CLICKHOUSE-2] 2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
d25338582d Speedup partition check, add more preformance output. [#CLICKHOUSE-2]
Faster partition check.

Added more debug info.
2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
704583968f Do not save resolved addresses in Connections. [#CLICKHOSUE-2]
Add disable_internal_dns_cache main config option.
2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
8fd72a6777 Add automatic DROP DNS CACHE, update of SYSTEM queries. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
400ad55754 Support allow_databases in distributed DDL. [#CLICKHOUSE-3]
Resolves #2189
2018-04-17 22:33:58 +03:00
Alexey Milovidov
e845d34569 Miscellaneous [#CLICKHOUSE-2] 2018-03-16 04:15:50 +03:00
Vitaliy Lyudvichenko
1f1870abd4 Add more priority to local ClusterCopier workers. [#CLICKHOUSE-2] 2018-03-14 23:49:18 +03:00
alexey-milovidov
04cc8a52f7
Merge pull request #2032 from yandex/system-table-macro
System table macro
2018-03-14 02:10:30 +03:00
Nikolai Kochetov
8b802ad774 added test for SYSTEM RELOAD CONFIG and system.macros [#CLICKHOUSE-3591] 2018-03-13 14:47:32 +03:00
alexey-milovidov
56deedfe9f
Merge pull request #2027 from yandex/CLICKHOUSE-3346
Sync insert and сluster copier enhancements
2018-03-12 20:58:53 +03:00
Vitaliy Lyudvichenko
30b69c84ae Fixed Illegal PREWHERE error for Merge tables over Distributed. [#CLICKHOUSE-3637] 2018-03-12 18:14:26 +03:00
Vitaliy Lyudvichenko
32b617e1d6 Fixed extra squashing leaded to too big timeouts. [#CLICKHOUSE-3346] 2018-03-11 21:36:09 +03:00
Alexey Zatelepin
ee91edaf70 fix test to conform to the new GROUP BY behaviour on empty tables 2018-03-07 18:09:26 +00:00
Vitaliy Lyudvichenko
17f39ab33f Add deferred initialization of shards if enabled_partitions are specified. [#CLICKHOUSE-3346] 2018-03-07 17:39:02 +03:00
Vitaliy Lyudvichenko
270b6c968e Speed up initialization, fixed settings passing. [#CLICKHOUSE-3346] 2018-03-07 17:39:02 +03:00
Vitaliy Lyudvichenko
d6635c3bf5 Fixed several integration tests. [#CLICKHOUSE-2] 2018-03-07 16:52:09 +03:00
Nikolai Kochetov
68357f3534 added macro.xml 2018-03-07 15:46:30 +03:00
Alexey Zatelepin
b0a4e1294d remove obsolete setting from test 2018-03-06 20:36:19 +00:00
Vitaliy Lyudvichenko
f89d9dbfb9 Fixed segfault in an integration test. [#CLICKHOUSE-2] 2018-02-27 21:46:16 +03:00
Vitaliy Lyudvichenko
4e27c268a1 Add clickhouse-copier description to the docs. [#CLICKHOUSE-3606] 2018-02-26 18:27:36 +03:00
Vitaliy Lyudvichenko
120530e44c Add requested changes. [#CLICKHOUSE-3606] 2018-02-26 15:14:20 +03:00
Vitaliy Lyudvichenko
11b4cf3163 Updated test. [#CLICKHOUSE-3606] 2018-02-24 01:47:35 +03:00
alexey-milovidov
b6f3f06ef3
Merge branch 'master' into CLICKHOUSE-3606 2018-02-22 02:13:38 +03:00
Vitaliy Lyudvichenko
fbe4066c15 Add support of any partition key. [#CLICKHOUSE-3606] 2018-02-21 20:18:31 +03:00
Vitaliy Lyudvichenko
47becc0b92 Try to reduce false positive of sanity check. More detail dignostics. [#CLICKHOUSE-3571] 2018-02-21 20:06:29 +03:00
Vitaliy Lyudvichenko
369f88f65d Rewritten and improved sync distributed insert. [#CLICKHOUSE-3346] 2018-02-19 20:26:47 +03:00
Vitaliy Lyudvichenko
ef98bff6e1
ClusterCopier improvements (#1869)
* Fixed race condition in StorageDistributed. [#CLICKHOUSE-2]

* ClusterCopier improvements. [#CLICKHOUSE-3346]

* Add performance metrics. [#CLICKHOUSE-3346]
2018-02-07 16:02:47 +03:00
Vitaliy Lyudvichenko
94f38d744e
Merge pull request #1750 from yandex/CLICKHOUSE-3346
Fault-tolerant cluster copier util
2018-01-31 13:21:51 +03:00
alexey-milovidov
bea49ca136
Merge pull request #1741 from yandex/array-functions-hasAll-hasAny-intersect
Array functions hasAll hasAny arrayIntersect arrayResize
2018-01-26 12:06:48 +03:00
Vitaliy Lyudvichenko
e2fb6d8c80 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346 2018-01-25 22:00:08 +03:00
Vitaliy Lyudvichenko
d0f42c8f2f Add kazoo lib into integration test, enhanced some tests. [#CLICKHOUSE-3346] 2018-01-25 21:14:37 +03:00
alexey-milovidov
24ac18201c Update getFQDNOrHostName.cpp
Update isLocalAddress.cpp

Update IBlockOutputStream.h

Update users.xml
2018-01-24 17:14:21 +03:00
Nikolai Kochetov
49101fb0a6 added test for macro for cluster name in Distributerd table and DDL [#CLICKHOUSE-3409] 2018-01-22 21:49:21 +03:00
Vitaliy Lyudvichenko
1000328571 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346 2018-01-22 20:31:08 +03:00
Vitaliy Lyudvichenko
0b8d2a2024 Fixed nondeterministic merge in GraphiteMergeTree. [#CLICKHOUSE-2860] 2018-01-18 23:30:03 +03:00
Nikolai Kochetov
de274b317a added ArraySourceVisitor and ArraySinkVisitor [#CLICKHOUSE-2998] 2018-01-18 18:50:35 +03:00
Vitaliy Lyudvichenko
3f9f1f7f4c Add forgoten file. [#CLICKHOUSE-2] 2018-01-16 15:12:21 +03:00
Vitaliy Lyudvichenko
f20f3f21c4 Update clusters in SYSTEM DROP DNS query. [#CLICKHOUSE-3478] 2018-01-15 17:57:47 +03:00
Alexey Milovidov
7a865af32a Integration tests: added clarification [#CLICKHOUSE-2]. 2018-01-12 21:14:54 +03:00
Vitaliy Lyudvichenko
388d47bbbc Merge branch 'CLICKHOUSE-3346-v310' into CLICKHOUSE-3346 2018-01-11 23:51:30 +03:00
Vitaliy Lyudvichenko
47616c31be Added enabled_partitions option. [#CLICKHOUSE-3346] 2018-01-11 21:55:47 +03:00
Vitaliy Lyudvichenko
43ae5a6932 Fixed test. [#CLICKHOUSE-3346] 2018-01-11 21:55:47 +03:00
Vitaliy Lyudvichenko
bdf96eed91 Add integration test and more options. [#CLICKHOUSE-3346] 2018-01-11 21:55:46 +03:00
Nikolai Kochetov
64fd3fe35a added test for Dictionary(range_hashed) [#CLICKHOUSE-3521] 2017-12-25 23:55:45 +03:00
Vitaliy Lyudvichenko
b738d1baed Add multi index for data_parts storage. And fixed bugs. [#CLICKHOUSE-3452]
Fixed handling of obsolete parts.
Fixed conflict resolution between simultaneous PreCommitted covering parts.
Fixed memory leak caused by ordinary MergeTree parts stucked in Deleting state.
Added hidden _state column into system.parts.
2017-11-29 14:25:11 +03:00
Vitaliy Lyudvichenko
2cf6e20fef Fixed a vague error message in integration tests. [#CLICKHOUSE-2] 2017-11-20 23:15:30 +03:00
Vitaliy Lyudvichenko
a4636f8656 Fixed incorrect INSERT into Distributed table in async mode with local replicas in a shard. #1404 [#CLICKHOUSE-2]
Resolves #1404
2017-11-03 00:32:59 +03:00
proller
8aafa3b042
Cmake: fix warnings (#1437)
* Cmake: fix warnings

* Tests: replace 127.0.0.1 -> localhost
2017-11-02 17:14:16 +03:00
Alexey Zatelepin
514a4d4fba use stale local replica if all remote replicas are unavailable [#CLICKHOUSE-3377] 2017-10-27 23:46:19 +03:00
Vitaliy Lyudvichenko
397b8bcf92 Smarter parts deletion. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
a5e29f2166 Add integration test. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
db3a67a421 Add clearer RangeFiltered implementation. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Nikolai Kochetov
adae8205a7 increased timeout for test_insertion_sync_fails_with_timeout 2017-10-23 16:56:42 +03:00
Vitaliy Lyudvichenko
723f36ec6d Fixed integration tests after introduction of 'clickhouse server' commands. [#CLICKHOUSE-2] 2017-10-04 18:15:40 +03:00
Vitaliy Lyudvichenko
c32bf4f597 Use only one cache in DNSCache. Add requested changes. [#CLICKHOUSE-2931] 2017-09-01 20:05:24 +03:00
alexey-milovidov
aa2d29f5f9 Update ReadWriteBufferFromHTTP.cpp, Context.cpp, etc
Update ASTSystemQuery.cpp

Update ASTSystemQuery.h

Update dictionary_clickhouse_cache.xml

Update dictionary_clickhouse_flat.xml
2017-08-31 13:26:02 +03:00
alexey-milovidov
5d14855989 Merge branch 'master' into CLICKHOUSE-2931 2017-08-31 00:23:39 +03:00
Nikolai Kochetov
d4bf2bf102 replaced tabs to spaces in config files [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
ee90da3014 added tests [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Vitaliy Lyudvichenko
4b0c7ecf21 Add integration tests for SYSTEM queries. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Vitaliy Lyudvichenko
b818258af9 Add ability to run an integration test env without test runs. [#CLICKHOUSE-2] 2017-08-25 16:51:12 +03:00
Nikolai Kochetov
7fa337c297 added tests [#CLICKHOUSE-3245] 2017-08-23 15:44:18 +03:00
Vitaliy Lyudvichenko
05d3f338ca Add useful .gitignore. [#CLICKHOUSE-2] 2017-08-14 15:03:43 +03:00
Vitaliy Lyudvichenko
33a50b4d65 Fix false IOError messages in integration tests log. [#CLICKHOUSE-2] 2017-08-14 14:49:30 +03:00
Alexey Milovidov
96d8ba9e3f Fixed typo [#CLICKHOUSE-2]. 2017-08-14 04:29:19 +03:00
Vitaliy Lyudvichenko
d9ce96f8f5 Fixed test and misspellings. [#CLICKHOUSE-3207] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
a34ab8201a Add FORMAT section for DDL queries CREATE, ALTER, RENAME, DROP. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
183c55676e Fixed ON CLUSTER DDL for Views. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
e4785aeb4d Simplified clean queue logic. Added more tests. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
c2e84d6df7 Fixed several errors in case of connection loss. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
cb02a1b3b5 Add random ZK packets drops into test. Fixed a couple bugs. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
c2cf3f81be Fix test after rebase. [#CLICKHOUSE-312] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
628de0a3ea Fixed logging of DDL queries. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
736feab79f Add port field. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Alexey Zatelepin
c99f3d7ee0 add test [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Nikolai Kochetov
b7f8ac1f2d rewrote rewriting of SELECT query in StorageMerge with WITH statement 2017-08-12 00:01:28 +03:00
Nikolai Kochetov
c88e8a79cc merged with master 2017-07-27 18:43:46 +03:00
Vitaliy Lyudvichenko
da9cdfc2f2 Fix integration tests. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
bf1949fc11 Add test. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
cd5bb4d921 Add replicated_deduplication_window_seconds merge_tree parameter. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Nikolai Kochetov
19d3c36871 added tests for synchronous insert into distributed table [#CLICKHOUSE-3033] 2017-07-26 17:41:21 +03:00
Alexey Zatelepin
2aaa847e10 add forgotten files [#CLICKHOUSE-3126] 2017-07-25 19:36:14 +00:00
Alexey Zatelepin
6567465d41 add failing test [#CLICKHOUSE-3163] 2017-07-21 20:55:38 +03:00
Nikolai Kochetov
5924b13f4c fixed unnecessary columns removing for merge table on distibuted 2017-07-12 21:51:51 +03:00
Alexey Zatelepin
5f1b2e9cb1 add test [#CLICKHOUSE-3126] 2017-07-11 20:56:17 +03:00
Alexey Zatelepin
7178fcbb53 attempt to fix integration tests 2017-07-11 20:56:17 +03:00
Alexey Zatelepin
18bff11da6 cosmetics [#CLICKHOUSE-1979] 2017-06-16 21:35:49 +03:00
Alexey Zatelepin
c90ea346ce add cross-replication test [#CLICKHOUSE-1979] 2017-06-16 21:24:18 +03:00
Vitaliy Lyudvichenko
aef0bf7e2e Fix trying to load database.sql from incorrect path. [#CLICKHOUSE-3044] 2017-06-16 19:08:24 +03:00
Vitaliy Lyudvichenko
67fdd0f544 Load the system database first. [#CLICKHOUSE-3044] 2017-06-16 19:08:24 +03:00
Alexey Zatelepin
deca700689 add failing test [#CLICKHOUSE-2911] 2017-06-15 18:45:45 +03:00
Alexey Zatelepin
ad379271ed add failing test [#CLICKHOUSE-3068] 2017-06-14 22:16:19 +03:00
Alexey Zatelepin
d95e5d40a3 fix integration tests 2017-06-14 16:23:23 +03:00
alexey-milovidov
a669136ac2 Merge branch 'master' into CLICKHOUSE-5 2017-06-13 07:30:36 +03:00
Nikolai Kochetov
bff77d1bae merged with master 2017-06-08 15:00:11 +03:00
Nikolai Kochetov
b931ca4edb removed cache dictionaries from test_select_all 2017-06-07 19:50:56 +03:00
Nikolai Kochetov
af661f9be1 integration tests for StorageDictionary 2017-06-07 19:43:07 +03:00
Vitaliy Lyudvichenko
73e2aab9ec Updated integration tests. Add integration test for DDL. [#CLICKHOUSE-5] 2017-06-01 13:49:21 +03:00
Alex Zatelepin
0b2e2ec20d Update README.md [#CLICKHOUSE-2821] 2017-05-29 22:05:36 +03:00
Alexey Zatelepin
df5fb65b28 specify db path in accordance with container volume mountpoint [#CLICKHOUSE-2821] 2017-05-23 23:52:48 +03:00
Alexey Zatelepin
2ffc01b25a build helper container with network=host to avoid problems with ipv6 [#CLICKHOUSE-2821] 2017-05-23 23:38:17 +03:00
Alexey Zatelepin
6200ccb39c improve waiting for instance startup in integration tests [#CLICKHOUSE-2821] 2017-05-23 20:13:36 +03:00
Alex Zatelepin
1bcee80587 Fixed README.md [#CLICKHOUSE-2821] 2017-05-23 17:27:18 +03:00
Alexey Milovidov
38281226bd Fixed error in integration tests [#CLICKHOUSE-2821]. 2017-05-23 17:24:04 +03:00
Alexey Milovidov
95059092d4 Fixed README.md [#CLICKHOUSE-2821] 2017-05-23 16:57:38 +03:00
Alexey Zatelepin
65227021e7 ClickHouse integration tests. [#CLICKHOUSE-2821] 2017-05-22 17:56:41 +04:00