Commit Graph

52452 Commits

Author SHA1 Message Date
Azat Khuzhin
8a4b29495b perf: override top_level_domains_path via command line arguments 2020-12-09 21:08:31 +03:00
Azat Khuzhin
352a1eea34 Use new top_level_domains_path 2020-12-09 21:08:31 +03:00
Azat Khuzhin
7b0c720922 Add top_level_domains into perf tests
And change Dockerfile to trigger image rebuild
2020-12-09 21:08:31 +03:00
Azat Khuzhin
840a21d073 Add top_level_domains_path for easier overriding 2020-12-09 21:08:31 +03:00
Azat Khuzhin
9b6b2b175f perf: merge custom_tld.xml/first_significant_subdomain.xml into url_hits.xml
v2: smaller table for *firstSignificantSubdomain* (max_threads=1)
2020-12-09 21:08:30 +03:00
Azat Khuzhin
c987be632f Switch TLDList to StringHashSet (to avoid errors on collisions) 2020-12-09 21:08:30 +03:00
Azat Khuzhin
89cb2185a8 Fix StringHashTable move constructor 2020-12-09 21:08:30 +03:00
Azat Khuzhin
8a0487b1af Add StringHashSet 2020-12-09 21:08:30 +03:00
Azat Khuzhin
8b6256dc4b Add performance test for custom TLD
And seems works with the same speed as default (that uses gperf):

- cutToFirstSignificantSubdomain

    SELECT cutToFirstSignificantSubdomain(URL)
    FROM datasets.hits
    SETTINGS max_threads = 1
    FORMAT Null
    SETTINGS max_threads = 1

    0 rows in set. Elapsed: 0.904 sec. Processed 8.87 million rows, 762.68 MB (9.82 million rows/s., 843.61 MB/s.)

- cutToFirstSignificantSubdomainCustom

    SELECT cutToFirstSignificantSubdomainCustom(URL, 'public_suffix_list')
    FROM datasets.hits
    SETTINGS max_threads = 1
    FORMAT Null
    SETTINGS max_threads = 1

    0 rows in set. Elapsed: 0.909 sec. Processed 8.87 million rows, 762.68 MB (9.76 million rows/s., 838.83 MB/s.)
2020-12-09 21:08:30 +03:00
Azat Khuzhin
8875767b87 Add a test for custom TLD 2020-12-09 21:08:30 +03:00
Azat Khuzhin
916cbd6610 Add ability to use custom TLD list
v2: Add a note that top_level_domains_lists aren not applied w/o restart
v3: Remove ExtractFirstSignificantSubdomain{Default,Custom}Lookup.h headers
v4: TLDListsHolder: remove FIXME for dense_hash_map (this is not significant)
2020-12-09 21:08:22 +03:00
robot-clickhouse
89a3a86b71 Update version_date.tsv after release 20.12.3.3 2020-12-09 19:14:28 +03:00
alesapin
d96019ece1
Merge pull request #17914 from yanhuqing666/patch-1
update typo of readme
2020-12-09 16:07:58 +03:00
alesapin
4d1f528806
Merge pull request #17918 from ClickHouse/revert-17120-fix_granularity_on_block_borders
Revert "Fix index granularity calculation on block borders"
2020-12-09 14:46:56 +03:00
Nikolai Kochetov
6a9e1ce436
Merge pull request #17895 from Enmk/DateTime64_DateTime_comparison
Date vs DateTime64 comparison
2020-12-09 14:22:26 +03:00
alesapin
7783ddb3af
Revert "Fix index granularity calculation on block borders" 2020-12-09 14:05:48 +03:00
Alexander Kuzmenkov
fa64d314df
Merge pull request #17907 from azat/perf-tiny-fix
Perf tests fixes
2020-12-09 12:29:57 +03:00
robot-clickhouse
351c64d3f4 Update version_date.tsv after release 20.6.11.1 2020-12-09 12:12:48 +03:00
tiger.yan
a44081011e
update typo of readme
typo
2020-12-09 16:22:46 +08:00
Azat Khuzhin
79e6348282 perf: load overrides last of all 2020-12-09 07:31:54 +03:00
robot-clickhouse
f901482085 Update version_date.tsv after release 20.12.2.1 2020-12-09 04:20:10 +03:00
Azat Khuzhin
d33b0ad33b Use interserver_http_port remove=remove over auto-port
Revert "perf: fix port conflict for tcp_with_proxy_port"

This reverts commit 89b3566824e5c0a87b6310fc4b6f9d300d2e17db.
2020-12-09 00:11:12 +03:00
Azat Khuzhin
75f9640fc2 perf: fix port conflict for tcp_with_proxy_port
Simply use zero port to do auto allocation, anyway it is not used in
perf tests.
2020-12-08 23:29:38 +03:00
alexey-milovidov
8ff30b87a6
Merge pull request #15930 from kitaisreal/clickhouse-client-and-local-added-queries-file-parameter
Clickhouse client and clickhouse local added queries-file parameter
2020-12-08 21:44:19 +03:00
alexey-milovidov
e127636a4b
Merge pull request #16787 from kitaisreal/fast-float-integration
FastFloat library integration
2020-12-08 21:34:34 +03:00
Azat Khuzhin
f1ac8775db perf: override config directives via command line over sed by config.xml 2020-12-08 21:25:03 +03:00
Vitaly Baranov
f6f336ac78
Merge pull request #17888 from vitlibar/retrieve-logs-from-grpc
Retrieve logs from grpc
2020-12-08 20:54:02 +03:00
Alexander Kuzmenkov
2706f01e1d
Merge pull request #17551 from sevirov/sevirov-DOCSUP-4525-document_output_format_json_array_of_rows
DOCSUP-4525: Document the output_format_json_array_of_rows setting
2020-12-08 20:43:16 +03:00
Alexander Kuzmenkov
e65299e290
Update settings.md 2020-12-08 20:43:00 +03:00
Alexander Kuzmenkov
46602c5a8b
Apply suggestions from code review 2020-12-08 20:42:23 +03:00
alexey-milovidov
56971fcb22
Merge pull request #17866 from dkxiaohei/patch-1
Update mysql.md
2020-12-08 18:07:53 +03:00
Vasily Nemkov
0c2d73adcb Fixed comparing Date and DateTime64 2020-12-08 17:17:02 +03:00
alexey-milovidov
d9b52f94f7
Merge pull request #17637 from amosbird/buildid
reload symbols and fix build-id
2020-12-08 14:55:35 +03:00
alexey-milovidov
ab10cb4bf9
Merge pull request #17707 from ClickHouse/quota-by-x-forwarded-for
Allow quotas to be keyed by proxy-forwarded IP address; add support for PROXY protocol
2020-12-08 14:48:05 +03:00
Alexander Kazakov
0e41af11c7
Fixed typo in message format (#17900) 2020-12-08 14:28:35 +03:00
Vasily Nemkov
5556c48298 Added test for DateTime vs DateTime64 comparison 2020-12-08 13:51:50 +03:00
Nikolai Kochetov
7d77a7ba24
Merge pull request #16952 from Enmk/DateTime64_fixes_comparison
Fixed comparison of DateTime64 with different scales
2020-12-08 12:40:41 +03:00
alesapin
44c7fa5788
Merge pull request #17878 from ClickHouse/fix-bad-code
Fix bad code
2020-12-08 10:20:29 +03:00
Alexey Milovidov
4ecfe8fef4 Remove unused headers 2020-12-08 02:10:22 +03:00
Alexey Milovidov
fa08c59d14 Fix bad test 2020-12-08 02:09:47 +03:00
alexey-milovidov
a7324f8b4c
Update InterpreterSystemQuery.cpp 2020-12-08 00:12:09 +03:00
Nikita Mikhaylov
1a01dbaa00
Merge pull request #17643 from nikitamikhaylov/rocksdb-patch
Switch RocksDB to patched version
2020-12-08 00:01:46 +03:00
Vitaly Baranov
ad01e877be Mark grpc protocol's tests as non-flaky. 2020-12-07 23:40:02 +03:00
Vitaly Baranov
559afe028f Retrieve logs from grpc library and pass them to our logging system. 2020-12-07 23:39:55 +03:00
Alexey Milovidov
0f437c86d3 Fix clang-tidy warning 2020-12-07 23:38:33 +03:00
Alexey Milovidov
a5f43ada94 Add missing config link 2020-12-07 23:36:47 +03:00
Vitaly Baranov
b8faa1663f Fix configs in tests. 2020-12-07 22:02:18 +03:00
Vitaly Baranov
76afe58bbf Fix commenting in the server config. 2020-12-07 21:50:55 +03:00
Amos Bird
08675028e5
fix build 2020-12-08 01:40:49 +08:00
Dmitriy
b767c7bfdd Merge remote-tracking branch 'remotes/clickhouse/master' into sevirov-DOCSUP-4525-document_output_format_json_array_of_rows 2020-12-07 20:08:40 +03:00