Commit Graph

18415 Commits

Author SHA1 Message Date
alesapin
f740334ee5 Faster scheme search
Add docs
2019-06-26 13:26:34 +03:00
alexey-milovidov
dca6d2947c
Merge pull request #5600 from Enmk/gorilla_column_encoding
Gorilla column encoding
2019-06-26 12:53:12 +03:00
hcz
da206109a6 Move registerFunctionConvertCharset 2019-06-26 16:05:53 +08:00
hcz
97b762ad06 Improve function registering 2019-06-26 15:53:43 +08:00
Nicolae Vartolomei
59d66bb1d5 clickhouse-copier: Allow empty database name
This is needed to make clickhouse-copier work with cross-replication
setups (also known as [circular replication][1]).

When database name is not specified we rely on `<default_database>`
element from replica stanza.

Example:

```xml
<source_cluster>
    <shard>
        <replica>
            <host>localhost</host>
            <port>9000</port>
            <default_database>r0</default_database>
        </replica>
        <replica>
            <host>localhost</host>
            <port>666</port>
            <default_database>r1</default_database>
        </replica>
    </shard>
    <shard>
        <replica>
            <host>localhost</host>
            <port>666</port>
            <default_database>r0</default_database>
        </replica>
        <replica>
            <host>localhost</host>
            <port>9000</port>
            <default_database>r1</default_database>
        </replica>
    </shard>
</source_cluster>
```

[1]: https://www.altinity.com/blog/2018/5/10/circular-replication-cluster-topology-in-clickhouse
2019-06-25 22:09:11 +00:00
alesapin
71872fc3c3 Disable cluster copier tests 2019-06-25 22:26:26 +03:00
alesapin
bd56f219ab Fix style 2019-06-25 19:15:00 +03:00
alesapin
ff72cf4893 Trying to do everything in one pass 2019-06-25 18:54:47 +03:00
alesapin
d3a5759c73 Disable tests and add global timeout 2019-06-25 16:20:04 +03:00
alesapin
57ed08f832
Merge pull request #5738 from yandex/hczhcz-patch-6
Slightly better style
2019-06-25 15:14:28 +03:00
Vasily Nemkov
138087d2e1 Performance tests for Gorilla and DoubleDelta
Testing INSERTs and SELECTs on codec combinations:
 * DoubleDelta (or Gorilla)
 * LZ4
 * DD (or G) + LZ4
On 3 types of data:
 * sequential
 * monotonic
 * random.
2019-06-25 13:47:55 +03:00
alesapin
4a8a70a079
Merge pull request #5720 from coraxster/fix-5377
MergedColumnOnlyOutputStream. Skip empty blocks. Fix 5377
2019-06-25 13:35:09 +03:00
alesapin
2fcb786093 Slightly more ClickHouse style 2019-06-25 13:17:11 +03:00
alesapin
b14a6ab8ab Merge branch 'patch-6' of https://github.com/hczhcz/ClickHouse into hczhcz-patch-6 2019-06-25 12:40:13 +03:00
alesapin
fff18f78db Fix tail detection 2019-06-25 12:12:28 +03:00
alesapin
fa88954e56 Better scheme cut 2019-06-25 12:04:35 +03:00
hcz
eff547cf70 Update test cases 2019-06-25 14:27:27 +08:00
hcz
3368ed933f Improve error codes 2019-06-25 12:39:00 +08:00
hcz
8a2c6985a4 Use size_t step 2019-06-25 12:37:40 +08:00
hcz
f1e146d208 Fix parameter handling 2019-06-25 12:28:20 +08:00
alesapin
48451b2b0f Better name 2019-06-24 22:00:40 +03:00
alexey-milovidov
b43e75200e
Merge pull request #5595 from inv2004/moving-sum
movingSum/Avg window functions for numeric and decimals
2019-06-24 19:13:26 +03:00
dmitry kuzmin
c72e4dfe08 5337: clang compiler fix 2019-06-24 18:07:01 +03:00
Alexey Milovidov
8f77d898f3 Renamed functions for consistency #5704 2019-06-24 17:51:37 +03:00
alexey-milovidov
8e41d89126
Merge pull request #5704 from zhang2014/fix/ISSUES-5697
ISSUES-5697 fix insert and select query with mysql style identifier
2019-06-24 17:40:28 +03:00
alexey-milovidov
dacbe9a410
Update WriteHelpers.h 2019-06-24 17:38:58 +03:00
alesapin
c6ece40f3c Fix minor bug and style 2019-06-24 16:04:20 +03:00
alesapin
88b9bc6254 Merge branch 'patch-6' of https://github.com/hczhcz/ClickHouse into hczhcz-patch-6 2019-06-24 14:29:35 +03:00
alesapin
5b378a3f01 Remove degug info 2019-06-24 14:18:53 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
alesapin
331e17d56a Return scheme logic 2019-06-24 14:16:08 +03:00
alesapin
56a7595254 Slightly speed up 2019-06-24 13:47:17 +03:00
dmitry kuzmin
c988293e1e 5337 fix: MergedColumn. skip empty blocks 2019-06-23 07:30:29 +03:00
zhang2014
029e2ccf1f some review fixes 2019-06-22 19:10:00 +08:00
zhang2014
b9cb1feb4c some review fixes 2019-06-22 12:40:41 +08:00
CurtizJ
53634a324e fix error with uninitialized system_logs 2019-06-21 22:24:30 +03:00
CurtizJ
ac3072cd9b better shutdown of system_logs 2019-06-21 20:25:47 +03:00
chertus
29700fd5e9 Auto version update to [19.11.0] [54423] 2019-06-21 18:47:02 +03:00
proller
badb6ab831
Functions: make array and gatherutils libs (#5712) 2019-06-21 18:31:37 +03:00
alesapin
8b263739ce Comments 2019-06-21 16:01:27 +03:00
alesapin
92509b71a4 Slightly speedup 2019-06-21 16:01:16 +03:00
alesapin
682e803fc9 Merge with master 2019-06-21 12:44:57 +03:00
zhang2014
1786407621 ISSUES-5697 fix insert and select query with mysql style identifier 2019-06-21 13:51:27 +08:00
alexey-milovidov
f6d150d9f8
Merge pull request #5688 from izebit/add-distributed_ddl_task_timeout-description
add description for distributed_ddl_task_timeout
2019-06-21 02:53:25 +03:00
proller
f111dbd45f Do not require gperf on build (#5701)
* Build fixes

* fix

* USE_GPERF

* wip

* wip

* wip

* test -j

* Simpler

* fix

* FunctionsURL.h -> URL/FunctionsURL.h

* clean

* clean

* Always use gperf-generated file

* Generator for tldLookup.generated.cpp

* clang-format
2019-06-21 02:50:53 +03:00
alexey-milovidov
606b074a4b
Merge pull request #5659 from yandex/ignore-mutation-limits
Ignore query execution limits and limits for max parts size for merge while executing mutations.
2019-06-21 02:14:41 +03:00
alexey-milovidov
73df46be2b
Merge pull request #5698 from abyss7/issue-5615
Lower the probability of hanging when shutting down Kafka storage
2019-06-21 02:11:07 +03:00
alexey-milovidov
bc15ebbb18
Merge pull request #5700 from yandex/join-use-nulls-5620
Fix #5620 issue about join_use_nulls setting
2019-06-21 02:08:05 +03:00
proller
da1814c2a8
Fix shared build (#5702) 2019-06-20 23:57:01 +03:00
CurtizJ
25cbc901ed fix deadlock at flushing on shutdown 2019-06-20 20:38:16 +03:00
proller
fa809de91f
Move all url functions to clickhouse_functions_url lib (#5696) 2019-06-20 18:49:54 +03:00
stavrolia
cb71e0c61c Add test 2019-06-20 17:05:33 +03:00
stavrolia
aff92c263e Make setting join_use_nulls get no effect for types that cannot be inside Nullable 2019-06-20 16:13:46 +03:00
akuzm
4cc9f632a0
Treat empty cells in CSV as default values. (#5625)
Treat empty cells in CSV as default values when input_format_defaults_for_omitted_fields = true.

Closes #5349.
2019-06-20 15:46:36 +03:00
Ivan Lezhankin
61750d09d2 Commit offsets for SELECTing from Kafka table too 2019-06-20 15:34:25 +03:00
dmitry kuzmin
3b45ac8bb6 fix macos compile 2019-06-20 13:26:19 +03:00
proller
3d8c8ee83c
Build fixes. Split config.h (#5686) 2019-06-20 12:12:49 +03:00
zhang2014
8221dd2a1a fix build and test failure 2019-06-20 08:33:37 +08:00
alexey-milovidov
c899fce9fc
Merge pull request #5661 from BHYCHIK/crc32-for-master
Support crc32 function
2019-06-20 01:32:00 +03:00
alexey-milovidov
1a19a36704
Update CRC32.cpp 2019-06-20 01:31:51 +03:00
alexey-milovidov
f943bbb7a3
Merge pull request #5684 from eejoin/master
Flush buffer when WriteBufferFromHDFS's destructor is called
2019-06-19 23:17:35 +03:00
CurtizJ
5e6ceef224 fix race condition in flushing system log 2019-06-19 19:50:17 +03:00
zhang2014
374aac3501 fix build & chmod shell test 2019-06-20 00:32:20 +08:00
Ivan Lezhankin
fdd3f07860 Don't do premature subscription to topics 2019-06-19 19:15:30 +03:00
CurtizJ
047ee38838 fix race condition in flushing system log 2019-06-19 18:38:06 +03:00
Vasily Nemkov
0b68f55ce0 Fixed UB in maskLowBits 2019-06-19 18:36:34 +03:00
zhang2014
166018e41e fix code style & rename minmax, set 2019-06-19 23:30:48 +08:00
zhang2014
a50aea09f1 fix float in bloom filter 2019-06-19 23:13:21 +08:00
zhang2014
d145295163 convert type with condition 2019-06-19 23:12:06 +08:00
zhang2014
6c8ff6dc31 add some test 2019-06-19 23:12:05 +08:00
zhang2014
f52b16e1e1 support bloom filter for any type 2019-06-19 23:12:05 +08:00
Artem Konovalov
0c4f32a4c0 add description for insert_distributed_timeout 2019-06-19 18:02:51 +03:00
Vasily Nemkov
219a09280d Updated test cases for gorilla to simplify debugging
Added case name and previous row values.
2019-06-19 17:51:48 +03:00
CurtizJ
bb95d9a860 fix race condition in flushing system log 2019-06-19 15:28:34 +03:00
Ivan Remen
b353b8347a Merge remote-tracking branch 'main/master' into crc32-for-master 2019-06-19 15:16:20 +03:00
eejoin
f3e0c60b89 Flush buffer when WriteBufferFromHDFS's destructor is called 2019-06-19 19:50:34 +08:00
Artem Zuikov
41302c9910
Merge pull request #5645 from coraxster/decimal-overflow-2
Fix float to decimal convert overflow, extreme values
2019-06-19 14:29:33 +03:00
Vasily Nemkov
e79c3d0e22 Post-PR fixes stage 3
maskLowBits()
building for clang
more test cases for codecs.
2019-06-19 13:38:15 +03:00
Ivan Remen
85fd2b3127 Fix compile 2019-06-19 11:33:45 +03:00
Ivan Remen
64231090cd Fix compile 2019-06-19 11:14:49 +03:00
Ivan Remen
60c85c4f24 Fix CRC32 function name in tests 2019-06-19 11:09:01 +03:00
Ivan Remen
f6b16e40af Rename file 2019-06-19 11:02:50 +03:00
Ivan Remen
80ee05eb8d Make CRC32 case insensitive 2019-06-19 10:59:38 +03:00
alexey-milovidov
9bdbd84263
Merge pull request #5030 from PerformanceVision/top_level_domain
Changing how the function (cutTo)firstSignificantSubdomain detect the tld (proposal)
2019-06-19 02:08:43 +03:00
stavrolia
c1fa22eecc wip 2019-06-18 20:16:20 +03:00
stavrolia
84871d9fa8 Remove <name> and <metrics> from performance tests fixed-5634 2019-06-18 19:55:13 +03:00
unknown
238c0e3b9b movingSum: uses template for groupArrayMovingSum and groupArrayMovingAvg 2019-06-18 10:18:33 -04:00
alesapin
4f98f875c3
Add ability to write final mark for *MergeTree engines family (#5624)
Add the ability to write final mark to *MergeTree engines family.
2019-06-18 15:54:27 +03:00
Ivan Remen
3fc8c8726f Merge remote-tracking branch 'main/master' into crc32-for-master 2019-06-18 15:29:50 +03:00
Ivan Remen
d70d8f533d Delete bad function 2019-06-18 11:23:56 +03:00
Ivan Remen
93df144ed1 Use zlib-ng crc32 2019-06-18 11:04:27 +03:00
Ivan Remen
232f40c436 Performance test done 2019-06-18 11:04:27 +03:00
dmitry kuzmin
a86f47421d simplify comparison 2019-06-18 08:25:16 +03:00
unknown
414bb21238 Merge remote-tracking branch 'upstream/master' into moving-sum 2019-06-17 19:09:58 -04:00
CurtizJ
2a04125360 fix ignore_limits option 2019-06-18 01:07:16 +03:00
Ivan Remen
edff6e58dc Support crc32 function 2019-06-18 00:54:26 +03:00
CurtizJ
e6dd92f9e1 ignore max part size for merge setting while executing mutations 2019-06-17 22:41:48 +03:00
Vasily Nemkov
81f9055d81 Post-PR fixes #2
Fixed style issues and build for clang-7;
64-bit buffer for BitReader and BitWriter;
Fixed overflow and writing more bytes on flushing;
Added maskLowBits() and tests for it.
2019-06-17 21:49:01 +03:00
Vasily Nemkov
0ebb145d32 Post-PR fixes:
* BitHelpers.cpp was removed, corresponding code was moved to the header
* BitIO test as GTest-based test binary
* gtest-based unit test for DoubleDelta and Gorilla codecs
* getLeadingZeroBits from SFINAE to consexpr if
* removed couple of unneeded if's
* Fixed sql-test to use one table
2019-06-17 21:39:45 +03:00
Vasily Nemkov
dfd8ff7675 Gorilla column encoding
Added Gorilla column encoding for any fixed-width type;
Added tests for Float32 and Float64 values.
2019-06-17 21:39:42 +03:00