Alexander Kuzmenkov
3da533766d
clang-tidy.......
2020-12-22 10:25:45 +03:00
Alexander Kuzmenkov
919172f9ee
more fuzzer fixes
2020-12-22 07:16:56 +03:00
Alexander Kuzmenkov
dadfc76f8f
fix the fuzzer
2020-12-22 07:02:39 +03:00
Alexey Milovidov
f9012b12fb
Proper implementation
2020-12-22 06:01:51 +03:00
Alexey Milovidov
932ade2cb8
Merge branch 'master' into watchdog
2020-12-22 03:10:15 +03:00
nikitamikhaylov
8501c7a831
better
2020-12-22 02:03:08 +03:00
nikitamikhaylov
cd3a73f9d3
done
2020-12-22 00:47:10 +03:00
Alexey Milovidov
7421a55cc4
Merge branch 'master' into harmful
2020-12-21 23:44:22 +03:00
alexey-milovidov
d66506299f
Merge pull request #18238 from azat/jemalloc-MADV_DONTNEED-runtime-check
...
MADV_DONTNEED check in runtime for qemu (via patching jemalloc)
2020-12-21 21:07:49 +03:00
Alexey Milovidov
157c66ebdb
Merge branch 'master' into harmful
2020-12-21 10:57:50 +03:00
Alexander Kuzmenkov
85c1bc1253
Merge remote-tracking branch 'origin/master' into tmp
2020-12-21 10:46:21 +03:00
Alexey Milovidov
b99634dc5d
Merge branch 'master' into harmful
2020-12-21 03:03:10 +03:00
Denis Glazachev
ea7e94f3eb
Use 127.0.0.1 as a default listen-host for ODBC bridge
2020-12-21 03:26:31 +04:00
Azat Khuzhin
e379b80d45
MADV_DONTNEED check in runtime for qemu (via patching jemalloc)
...
qemu does not support MADV_DONTNEED, and by not support it simply ignore
it (i.e. return 0 -- no error).
This issue has been "fixed" in #15590 , however it just
terminates the process, and completely breaks clickhouse under qemu
(see also #15174 ).
But there is no need in such strong protection, we can stop using
madvise in jemalloc if MADV_DONTNEED does not work properly.
And this is what #18169 was tried to do (by override madvise), however
this will break sanitizers, at least TSAN and UBSAN.
The problem there is that sanitizers initialization code uses madvise
(and there is no way to turn this off with TSAN_OPTIONS) and overwritten
madvise function will have sanitizers traits (__tsan_func_entry), while
TSAN is not ready for this, and eventually it SIGSEGV.
Interesting thing is that in the recent clang-12, madvise was replaced
with direct syscall [1].
[1]: 9f8c4039f2
But it is better to make clickhouse compatible with clang < 12 too, so
instead of override madvise completely, the runtime check was moved into
the jemalloc code [2].
[2]: https://github.com/ClickHouse-Extras/jemalloc/pull/1
2020-12-19 15:34:12 +03:00
Alexey Milovidov
ecc270605d
Fix error (CC @akuzm)
2020-12-19 01:07:52 +03:00
Alexey Milovidov
7805e84b4b
Return clickhouse-git-import
2020-12-19 00:19:11 +03:00
Alexey Milovidov
9c3fbc9ac6
Return clickhouse-git-import
2020-12-19 00:04:03 +03:00
Amos Bird
c447628d42
Add connection thread metrics
2020-12-18 15:22:55 +08:00
alexey-milovidov
6a5ce2eea7
Update config.xml
2020-12-18 07:58:56 +03:00
alexey-milovidov
44734a829e
Merge pull request #18207 from ClickHouse/better-config
...
Better config: example ports, security advices
2020-12-18 06:39:35 +03:00
alexey-milovidov
b4a59aecfe
Update config.xml
2020-12-18 06:39:21 +03:00
Nikita Mikhaylov
b1d1ea0e01
Update Install.cpp
2020-12-18 06:17:23 +03:00
Alexander Kuzmenkov
5e19eaf2f0
Merge remote-tracking branch 'origin/master' into tmp
2020-12-18 03:49:59 +03:00
Alexander Kuzmenkov
157fe3e8b4
some tests + ability to echo the queries
2020-12-18 03:49:18 +03:00
Nikita Mikhaylov
80fae17545
Update Install.cpp
2020-12-18 03:30:01 +03:00
Alexander Kuzmenkov
fc426807a8
formatting & fuzzer support
2020-12-18 03:21:23 +03:00
Nikita Mikhailov
6a55e018e4
Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel-parsing-input-format
2020-12-18 02:25:32 +03:00
nikitamikhaylov
d3c64e7528
cleanup
2020-12-18 02:12:38 +03:00
nikitamikhaylov
b04a7e8212
style
2020-12-18 02:12:38 +03:00
nikitamikhaylov
faee2b30bd
better
2020-12-18 02:12:38 +03:00
nikitamikhaylov
aeef47fd71
first try
2020-12-18 02:12:38 +03:00
Nikita Mikhaylov
aa7793e38f
Merge pull request #18084 from nikitamikhaylov/fix-arcadia-third
...
Try to fix Arcadia
2020-12-18 01:54:42 +03:00
Alexey Milovidov
92d8840ae5
Better config: example ports, security advices
2020-12-18 00:31:09 +03:00
Alexey Milovidov
f7f8ff8758
Merge branch 'master' into sigaltstack
2020-12-17 22:16:30 +03:00
Alexey Milovidov
08cc43da81
Merge branch 'master' into harmful
2020-12-17 21:08:48 +03:00
Denis Glazachev
53db7e564c
Do transformations based on prefix only
2020-12-17 18:29:05 +04:00
alesapin
66228f4054
Merge pull request #18065 from ClickHouse/fix_watch_race_testkeeper
...
Remove dead list watches from TestKeeperStorage
2020-12-17 10:15:30 +03:00
Alexey Milovidov
bef492240c
Apply harmful library only for clickhouse binary
2020-12-17 06:45:46 +03:00
Alexey Milovidov
7f280bef37
Merge branch 'master' into sigaltstack
2020-12-17 05:09:10 +03:00
Nikolai Kochetov
d96ca3fb8d
Fixing build.
2020-12-16 20:11:32 +03:00
nikitamikhaylov
5521abba1e
fix boost
2020-12-16 15:57:42 +03:00
alesapin
ea4d11cb73
Wait for connections to special servers
2020-12-16 13:04:46 +03:00
nikitamikhaylov
b5436547ff
thread tests
2020-12-15 00:56:48 +03:00
nikitamikhaylov
12e624fd9a
fix tests
2020-12-15 00:56:48 +03:00
nikitamikhaylov
f7ac8bf542
rebase and fix tests
2020-12-15 00:56:48 +03:00
nikitamikhaylov
67766034f2
disable progress bar with parallel_formatting
2020-12-15 00:56:47 +03:00
nikitamikhaylov
57705f5b73
delete and fix strange code
2020-12-15 00:56:47 +03:00
Nikita Mikhaylov
161c921dba
fix build
2020-12-15 00:56:47 +03:00
Nikita Mikhaylov
5a47928431
save
2020-12-15 00:56:47 +03:00
Nikita Mikhaylov
0e31424c92
save changes
2020-12-15 00:56:47 +03:00
Nikita Mikhaylov
82888b5c4d
fix build
2020-12-15 00:56:47 +03:00
Nikita Mikhaylov
3bc1affd21
remove CSV restriction
2020-12-15 00:56:47 +03:00
Alexey Milovidov
149431ffc3
Automatic support for dark theme in Play interface
2020-12-13 20:54:57 +03:00
alexey-milovidov
04e222f6f3
Merge pull request #17986 from azat/fwd-decl
...
More forward declaration for generic headers
2020-12-13 01:12:05 +03:00
Alexey Milovidov
2ad5c8eed3
Allow server to start with TestKeeper port in development environment
2020-12-13 00:45:23 +03:00
Azat Khuzhin
5b3ab48861
More forward declaration for generic headers
...
The following headers are pretty generic, so use forward declaration as
much as possible:
- Context.h
- Settings.h
- ConnectionTimeouts.h
(Also this shows that some missing some includes -- this has been fixed)
And split ConnectionTimeouts.h into ConnectionTimeoutsContext.h (since
module part cannot be added for it, due to recursive build dependencies
that will be introduced)
Also remove Settings from the RemoteBlockInputStream/RemoteQueryExecutor
and just pass the context, since settings was passed only in speicifc
places, that can allow making a copy of Context (i.e. Copier).
Approx results (How much units will be recompiled after changing file X?):
- ConnectionTimeouts.h
- mainline: 100
- Context.h:
- mainline: ~800
- patched: 415
- Settings.h:
- mainline: 900-1K
- patched: 440 (most of them because of the Context.h)
2020-12-12 17:43:10 +03:00
Alexander Kuzmenkov
fb1221148d
Merge pull request #17748 from azat/custom-TLD
...
Add ability to use custom TLD list
2020-12-11 12:42:19 +03:00
Azat Khuzhin
352a1eea34
Use new top_level_domains_path
2020-12-09 21:08:31 +03:00
Azat Khuzhin
840a21d073
Add top_level_domains_path for easier overriding
2020-12-09 21:08:31 +03:00
Azat Khuzhin
916cbd6610
Add ability to use custom TLD list
...
v2: Add a note that top_level_domains_lists aren not applied w/o restart
v3: Remove ExtractFirstSignificantSubdomain{Default,Custom}Lookup.h headers
v4: TLDListsHolder: remove FIXME for dense_hash_map (this is not significant)
2020-12-09 21:08:22 +03:00
alesapin
850f903d40
Merge branch 'master' into complete_zk_api
2020-12-09 18:18:38 +03:00
alesapin
0dd9c720f4
Better server
2020-12-09 11:58:41 +03:00
alesapin
758dcd1972
Separate factory for test keeper handlers
2020-12-09 11:45:36 +03:00
alexey-milovidov
8ff30b87a6
Merge pull request #15930 from kitaisreal/clickhouse-client-and-local-added-queries-file-parameter
...
Clickhouse client and clickhouse local added queries-file parameter
2020-12-08 21:44:19 +03:00
Vitaly Baranov
f6f336ac78
Merge pull request #17888 from vitlibar/retrieve-logs-from-grpc
...
Retrieve logs from grpc
2020-12-08 20:54:02 +03:00
alesapin
3d0dbbe411
Fix build
2020-12-08 17:49:18 +03:00
alexey-milovidov
ab10cb4bf9
Merge pull request #17707 from ClickHouse/quota-by-x-forwarded-for
...
Allow quotas to be keyed by proxy-forwarded IP address; add support for PROXY protocol
2020-12-08 14:48:05 +03:00
Vitaly Baranov
559afe028f
Retrieve logs from grpc library and pass them to our logging system.
2020-12-07 23:39:55 +03:00
Vitaly Baranov
76afe58bbf
Fix commenting in the server config.
2020-12-07 21:50:55 +03:00
Maksim Kita
963ee5211b
Added queries-file parameter. Fixed code review issues
2020-12-07 19:29:17 +03:00
Maksim Kita
f5d1a9e59a
Clickhouse client and local added queries-file parameter
2020-12-07 19:29:17 +03:00
Alexey Milovidov
1ed329017b
Merge branch 'master' into quota-by-x-forwarded-for
2020-12-07 18:22:19 +03:00
Maksim Kita
ee33323d1e
Added tests
2020-12-07 11:35:44 +03:00
spongedc
5914e6e451
Refine documents for system log table, and fix a link error in config.xml
2020-12-07 16:04:29 +08:00
alesapin
0c43246216
Merge branch 'master' into complete_zk_api
2020-12-07 10:24:55 +03:00
Maksim Kita
97cfaea182
Clickhouse-benchmark added query parameter
2020-12-06 11:53:02 +03:00
Alexey Milovidov
1e943babcc
Do not add empty query to browser history
2020-12-03 23:20:09 +03:00
Alexey Milovidov
3e2447391b
Support for PROXY protocol
2020-12-03 00:05:51 +03:00
alesapin
93ea2f5b1f
Merge branch 'master' into complete_zk_api
2020-12-02 11:30:09 +03:00
Alexander Kuzmenkov
6e1512304c
no TTL by default, as before
2020-12-01 15:59:31 +03:00
spongedc
9e995d9756
1.make ttl option more generic 2. add check if engine specified for system log
2020-12-01 00:29:36 +08:00
spongedc
d96600678d
Merge remote-tracking branch 'origin/master' into add_ttl_option_for_syslog
2020-11-30 22:53:52 +08:00
alesapin
6d2a007b79
Merge branch 'master' into complete_zk_api
2020-11-30 10:58:25 +03:00
alexey-milovidov
0c831e1204
Merge pull request #17301 from ClickHouse/odbc-minor-changes
...
Minor changes for ODBC storage
2020-11-29 21:23:20 +03:00
Alexey Milovidov
24bd2e8e8e
GRPC: better config
2020-11-28 08:44:16 +03:00
Nikita Mikhaylov
0b6f5c75b9
Merge pull request #17435 from vitlibar/grpc-protocol-2
...
Implement GRPC protocol (corrections)
2020-11-27 15:19:50 +03:00
alesapin
d199a2bf76
Merge branch 'master' into complete_zk_api
2020-11-27 14:55:55 +03:00
felixxdu
17e83cbb8d
Merge remote-tracking branch 'origin/master' into add_ttl_option_for_syslog
2020-11-27 10:02:57 +08:00
alexey-milovidov
77b5fa9468
Merge pull request #17421 from ClickHouse/clickhouse-install-improvements
...
ClickHouse install script improvements
2020-11-26 23:12:57 +03:00
alexey-milovidov
f086f56379
Merge pull request #17428 from ClickHouse/simplify-init-script-2
...
Simplify init script (part 2)
2020-11-26 23:06:01 +03:00
Nikolai Kochetov
9291bbb04b
Merge pull request #16804 from vdimir/ip-dict-no-trie
...
sorted-array based ip_dict
2020-11-26 19:26:06 +03:00
Denis Glazachev
81280072df
Merge branch 'master' into ldap-role-mapping
...
* master: (207 commits)
Update RadixSort.h
rerun tests to be sure
Update date_time_short perf test for toUnixTimestamp(Date())
update test
remove comments
better
fix tests
style
update copy pasted test
better
comments
better merge
new interface for the function
better
Fix comments
Add missing file
Make the code less bad
initial
test added
style
...
2020-11-26 18:29:13 +04:00
felixxdu
4cc6594cb8
Support configure Ssystem log table's ttl in config.xml
2020-11-26 17:37:42 +08:00
Vitaly Baranov
1fc43b3c93
Remove trailing whitespaces in config.xml
2020-11-26 10:27:04 +03:00
Vitaly Baranov
2063cbae0e
Remove old and broken C++ grpc-client.
2020-11-26 10:23:01 +03:00
Vitaly Baranov
49cf980761
Use port 9100 for grpc by default.
2020-11-26 10:14:27 +03:00
Alexey Milovidov
36151b9e54
Simplify init script (part 2)
2020-11-26 07:54:18 +03:00
alexey-milovidov
8eccf680d8
Update ODBCBlockInputStream.cpp
2020-11-26 07:11:34 +03:00
alexey-milovidov
aca4da7a2b
Update Install.cpp
2020-11-26 07:07:48 +03:00
Alexey Milovidov
2ff3e96e95
Many fixes in Install script
2020-11-26 05:11:55 +03:00
Alexey Milovidov
e89d1632a1
Improvements of Install script
2020-11-26 04:44:26 +03:00
Alexander Kuzmenkov
394b81ac46
Merge remote-tracking branch 'origin/master' into HEAD
2020-11-25 23:38:55 +03:00
Nikolai Kochetov
729272391f
Merge branch 'master' into ip-dict-no-trie
2020-11-25 23:07:19 +03:00
alesapin
fb86eaf6fc
Better errors and better config
2020-11-25 16:19:09 +03:00
Nikita Mikhaylov
d6dd133bee
Merge pull request #17363 from nikitamikhaylov/copier-uninitialized-var
...
Initialize unitialized variable
2020-11-25 15:12:42 +03:00
Nikita Mikhaylov
27acf6462f
Merge pull request #17248 from kaka11chen/15235
...
Fix #15235 . When clickhouse-copier handle non-partitioned table, throws segfault error.
2020-11-25 14:31:59 +03:00
Alexander Kuzmenkov
edce1e636e
Merge pull request #16535 from ClickHouse/aku/opentelemetry
...
OpenTelemetry improvements
2020-11-25 14:10:17 +03:00
alesapin
310307fa72
Replace eventfd with pipes
2020-11-25 11:18:15 +03:00
alesapin
4d40d9be3f
Merge branch 'master' into complete_zk_api
2020-11-25 10:31:16 +03:00
chenqi
302cd55f45
Fix #15235 . When clickhouse-copier handle non-partitioned table, throw segfault error.
2020-11-25 11:52:00 +08:00
Alexander Kuzmenkov
1d7dcef4a0
Merge remote-tracking branch 'origin/master' into HEAD
2020-11-24 21:45:10 +03:00
nikitamikhaylov
ebd51db987
better
2020-11-24 21:22:50 +03:00
Vitaly Baranov
3c85165e60
Redirect stderr, stdout for clickhouse-odbc-bridge to files.
2020-11-24 17:55:02 +03:00
Vitaly Baranov
eab3006a4d
Support SSL and compression when using gRPC protocol.
2020-11-24 17:55:02 +03:00
Vitaly Baranov
c2edd9f8ce
Rework async server: switch to coroutine-like approach, no using statuses anymore for control flow.
2020-11-24 17:53:34 +03:00
Vitaly Baranov
ff62fd4967
Add an adapter for protocol servers.
2020-11-24 17:53:34 +03:00
Vitaly Baranov
44717797c9
Fix code style and compilation.
2020-11-24 17:53:34 +03:00
Vitaly Baranov
13f2352c57
Move files to right places.
2020-11-24 17:53:34 +03:00
mnkonkova
6cd1557d67
Implement GRPC protocol.
2020-11-24 17:53:34 +03:00
nikitamikhaylov
31505fb279
done
2020-11-24 17:40:38 +03:00
myrrc
fbb0e6e6aa
Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted
2020-11-24 16:04:17 +03:00
alesapin
c1a7e4f5fa
Merge branch 'master' into complete_zk_api
2020-11-24 13:37:51 +03:00
Denis Glazachev
a367abb88f
Merge branch 'master' into ldap-cache-login
...
* master: (70 commits)
Update documentation-issue.md
Add an option to use existing tables to perf.py
DOCSUP-4280: Update the SELECT query (#17231 )
DOCSUP-3584 edit and translate (#17176 )
Fixed flaky test_storage_s3::test_custom_auth_headers
Update 01560_merge_distributed_join.sql
Minor improvements
Slightly more correct
Auto version update to [20.13.1.1] [54444]
Auto version update to [20.12.1.5236] [54443]
Update roadmap
Add favicon; add loading indicator
Fix race condition; history and sharing capabilities
Update bitmap-functions.md
Fix exception message
Use default value for read-only flag in metadata for Disk3.
ISSUES-16605 try fix review comment
trigger CI
ISSUES-16605 try fix integration failure
ISSUES-16605 try fix integration test failure
...
2020-11-24 02:55:20 +04:00
Denis Glazachev
b02f2cf1ca
Merge branch 'master' into ldap-role-mapping
...
* master: (50 commits)
Update documentation-issue.md
Add an option to use existing tables to perf.py
DOCSUP-4280: Update the SELECT query (#17231 )
DOCSUP-3584 edit and translate (#17176 )
Fixed flaky test_storage_s3::test_custom_auth_headers
Update 01560_merge_distributed_join.sql
Minor improvements
Slightly more correct
Auto version update to [20.13.1.1] [54444]
Auto version update to [20.12.1.5236] [54443]
Update roadmap
Add favicon; add loading indicator
Fix race condition; history and sharing capabilities
Update bitmap-functions.md
Fix exception message
Use default value for read-only flag in metadata for Disk3.
ISSUES-16605 try fix review comment
trigger CI
ISSUES-16605 try fix integration failure
ISSUES-16605 try fix integration test failure
...
2020-11-24 02:53:26 +04:00
alesapin
1de175257b
More const
2020-11-23 23:22:04 +03:00
alesapin
5a48076802
Trying to get rid of leak
2020-11-23 13:55:00 +03:00
Alexey Milovidov
77c963dec5
Minor changed for ODBC storage
2020-11-23 13:32:56 +03:00
alesapin
b8fb44a7b9
Merge with master
2020-11-23 11:05:50 +03:00
Alexey Milovidov
fdc11cb739
Minor improvements
2020-11-23 11:05:13 +03:00
Alexey Milovidov
56651a94c4
Slightly more correct
2020-11-23 10:52:33 +03:00
Alexey Milovidov
f3e567b4b4
Update roadmap
2020-11-23 10:15:52 +03:00
Alexey Milovidov
5058c56ecf
Add favicon; add loading indicator
2020-11-23 10:15:33 +03:00
Alexey Milovidov
2c982b4ccf
Fix race condition; history and sharing capabilities
2020-11-23 09:35:08 +03:00
Denis Glazachev
1a587b0c21
Merge branch 'master' into ldap-role-mapping
...
* master: (159 commits)
Review fix.
Update version_date.tsv after release 20.8.7.15
wrong translation
Update version_date.tsv after release 20.9.6.14
Update version_date.tsv after release 20.10.5.10
Update version_date.tsv after release 20.11.4.13
Improvements in coverage images
Fixed a problem with the translation of the document
final_parallel
final_parallel
DOCSUP-4162: Document the system.replicated_fetches system table (#16900 )
Update settings.md
Update settings.md
Less verbose logging when fetch is impossible
Don't add tons of client coverage files in stateful tests with coverage
More compatible watches in TestKeeper
Trying to make read_in_order_many_parts more stable
trigger CI
Update version_date.tsv after release 20.6.10.2
Update visibleWidth.cpp
...
2020-11-22 00:58:55 +04:00
Denis Glazachev
c12e6ae7c5
Actualize
...
Add role_mapping documentation (comments)
2020-11-21 00:49:29 +04:00
Tai White
43fce34eec
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into ldap-cache-login
2020-11-20 20:56:36 +01:00
alesapin
0208751a7d
Add dirty hack for connections close
2020-11-20 15:46:05 +03:00
vdimir
36544a45b7
Merge remote-tracking branch 'upstream/master' into ip-dict-no-trie
2020-11-19 18:56:24 +03:00
alesapin
991386e37b
Fix stupid error
2020-11-19 13:56:36 +03:00
Azat Khuzhin
dd0fccae47
Disable rotation of the logs in tests (on CI)
...
Right now due to rotation the archive with the clickhouse-server.log
maybe not full, for example:
- not full - https://clickhouse-test-reports.s3.yandex.net/16947/caf5f98db2ae39dd911f7d1fc0a7c2cc382b1c53/functional_stateless_tests_(ubsan)/clickhouse-server.log (no messages about server start)
- full - https://clickhouse-test-reports.s3.yandex.net/16993/d1f52dc72d417580c4088cf3880593176416bea2/functional_stateless_tests_(thread).html
And sometimes rotated part may include relative part of the log, so it
is better to disable it.
2020-11-19 01:08:47 +03:00
Azat Khuzhin
8a7376247b
Add a comment about rotation policy into server config
2020-11-19 01:07:09 +03:00
Alexander Kuzmenkov
1570320e20
fixes for context hierarchy
2020-11-18 20:43:18 +03:00
alesapin
2cd66f23a3
Merge branch 'master' into complete_zk_api
2020-11-18 17:50:50 +03:00
Alexey Milovidov
3df04ce0c2
Follow Arcadia ya.make rules
2020-11-16 21:24:58 +03:00
myrrc
862c8a428c
Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted
2020-11-16 14:40:49 +03:00
alexey-milovidov
3940babab5
Merge pull request #16936 from ClickHouse/filimonov-install-always-create-missing-dirs
...
Install script should always create subdirs in config folders.
2020-11-14 17:22:57 +03:00
myrrc
b1c0089b78
Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted
2020-11-14 16:50:04 +03:00
filimonov
0e4cbf7508
Update programs/install/Install.cpp
2020-11-13 12:31:37 +01:00
Alexey Milovidov
7d1c0f5b28
Fixed bug in git-import tool
2020-11-13 04:36:34 +03:00
filimonov
8a20133373
style
2020-11-12 18:28:24 +01:00