Commit Graph

5147 Commits

Author SHA1 Message Date
Azat Khuzhin
e379b80d45 MADV_DONTNEED check in runtime for qemu (via patching jemalloc)
qemu does not support MADV_DONTNEED, and by not support it simply ignore
it (i.e. return 0 -- no error).

This issue has been "fixed" in #15590, however it just
terminates the process, and completely breaks clickhouse under qemu
(see also #15174).

But there is no need in such strong protection, we can stop using
madvise in jemalloc if MADV_DONTNEED does not work properly.
And this is what #18169 was tried to do (by override madvise), however
this will break sanitizers, at least TSAN and UBSAN.
The problem there is that sanitizers initialization code uses madvise
(and there is no way to turn this off with TSAN_OPTIONS) and overwritten
madvise function will have sanitizers traits (__tsan_func_entry), while
TSAN is not ready for this, and eventually it SIGSEGV.
Interesting thing is that in the recent clang-12, madvise was replaced
with direct syscall [1].

  [1]: 9f8c4039f2

But it is better to make clickhouse compatible with clang < 12 too, so
instead of override madvise completely, the runtime check was moved into
the jemalloc code [2].

  [2]: https://github.com/ClickHouse-Extras/jemalloc/pull/1
2020-12-19 15:34:12 +03:00
alexey-milovidov
753aa36baf
Merge pull request #18234 from ClickHouse/return-git-import
Return clickhouse-git-import
2020-12-19 13:00:19 +03:00
alexey-milovidov
086916a853
Update regression.py 2020-12-19 03:32:50 +03:00
Alexey Milovidov
231cce489d Add a test 2020-12-19 01:08:05 +03:00
Alexey Milovidov
ce32a55fd6 Preparation 2020-12-19 00:54:24 +03:00
Alexey Milovidov
93bf494108 Preparation 2020-12-19 00:19:28 +03:00
Anton Popov
07bc3579d0
Merge pull request #18219 from CurtizJ/add-test
Add test for fixed bug with skip indices
2020-12-18 23:11:17 +03:00
alexey-milovidov
03bc2d328a
Merge pull request #17726 from amosbird/querylog
Extensive information in system.query_log
2020-12-18 21:24:21 +03:00
Ivan
6d5912e633
Update query_test.py 2020-12-18 19:01:04 +03:00
Nikolai Kochetov
d7fc426458
Merge pull request #18216 from ClickHouse/fix-18137
Fix 18137
2020-12-18 18:49:02 +03:00
Vasily Nemkov
5ff7baf663 Fixed comparing Date and DateTime64
With a less flakky test
2020-12-18 17:47:08 +02:00
alexey-milovidov
3261392f16
Merge pull request #18208 from vzakaznikov/update_testflows_version_to_1.6.72
Updating TestFlows version to the latest 1.6.72
2020-12-18 18:03:00 +03:00
alexey-milovidov
8491bcad22
Delete requirements.py 2020-12-18 18:02:19 +03:00
alexey-milovidov
34e4ace029
Merge pull request #17525 from ClickHouse/null-as-default-default
Attempt to make NULL as default by default
2020-12-18 18:00:34 +03:00
alexey-milovidov
7ec772f480
Merge pull request #18129 from ClickHouse/boringssl2
Port to BoringSSL (part 2)
2020-12-18 18:00:10 +03:00
Vitaliy Zakaznikov
f3a8f5dc45 Merging requirements for AES encryption functions.
Updating aes_encryption tests to use new requirements.
Updating TestFlows version to 1.6.72.
2020-12-18 09:06:36 -05:00
Anton Popov
820e0cf877 add test for fixed bug 2020-12-18 16:41:47 +03:00
Ivan
57763e6867
Enable Pytest framework for stateless tests (#17902) 2020-12-18 16:26:11 +03:00
Nikolai Kochetov
8012951e77 Add test. 2020-12-18 11:34:20 +03:00
Amos Bird
78b0b9b4fb
fix enum int keycondition 2020-12-18 16:10:54 +08:00
Amos Bird
2a28c127eb
Better code for real 2020-12-18 14:13:59 +08:00
Amos Bird
272311f6bd
Extensive information in system.query_log 2020-12-18 14:13:58 +08:00
jianmei zhang
d04376ebcc auto merge and rebase master 2020-12-18 13:24:13 +08:00
Alexey Milovidov
a0f7a12c4f Merge branch 'master' into null-as-default-default 2020-12-18 08:09:35 +03:00
alexey-milovidov
0d9519a0a2
Merge pull request #17567 from ClickHouse/insert_quorum_parallel-default
Insert quorum parallel by default
2020-12-18 08:08:26 +03:00
Alexey Milovidov
6c62301894 Merge branch 'master' of github.com:yandex/ClickHouse into boringssl2 2020-12-18 07:59:18 +03:00
Alexey Milovidov
2b09856ce5 Temporarily remove TestFlows before #18208 2020-12-18 06:40:36 +03:00
Alexey Milovidov
56054b90f6 Change format of dhparam in integration test 2020-12-18 06:35:20 +03:00
Alexey Milovidov
1be41beca0 Merge branch 'master' into boringssl2 2020-12-18 05:59:30 +03:00
Vitaliy Zakaznikov
766dd763ec Fixing requirement name in tests/testflows/example/tests/example.py 2020-12-17 18:16:33 -05:00
Vitaliy Zakaznikov
7db2652ab3 Updating TestFlows test version to the latest 1.6.72
Re-generating all requirements.py
2020-12-17 18:02:07 -05:00
Nikita Mikhaylov
aa7793e38f
Merge pull request #18084 from nikitamikhaylov/fix-arcadia-third
Try to fix Arcadia
2020-12-18 01:54:42 +03:00
tavplubix
8bc9d8ed7e
Merge pull request #18198 from ClickHouse/materialize_mysql_optimize_on_insert
Enable optimize_on_insert for MaterializeMySQL
2020-12-18 01:50:32 +03:00
alexey-milovidov
6fc3ca8b7b
Merge pull request #16724 from kitaisreal/added-function-accurate-cast-or-null
Added function accurateCastOrNull, allow different types inside IN subquery
2020-12-18 00:45:27 +03:00
alesapin
799997db35
Merge pull request #16621 from arenadata/ADQM-148
HDFS configuration and Kerberos Authenticaiton
2020-12-17 23:16:58 +03:00
alesapin
30c98adde4 Fix local variable in clickhouse-test 2020-12-17 23:13:49 +03:00
Vitaly Baranov
b9c537ac37
Merge pull request #18104 from vitlibar/fix-access-rights-for-merge-table-function-2
Fix access rights required for the merge() table function #2.
2020-12-17 22:59:33 +03:00
Vitaly Baranov
d9125a4822
Merge pull request #18014 from vitlibar/fix-showing-temporary-tables-in-system-tables
Fix showing temporary tables in system tables
2020-12-17 22:59:09 +03:00
alesapin
82ed528d98
Merge pull request #18191 from ClickHouse/hard_watches_test
Test watches for in-memory zookeeper
2020-12-17 22:51:52 +03:00
Alexey Milovidov
e4433157e7 Merge branch 'master' into insert_quorum_parallel-default 2020-12-17 22:42:32 +03:00
Alexey Milovidov
c2b0f9d530 Update integration test 2020-12-17 22:42:15 +03:00
Alexey Milovidov
6e0bb11fe2 Tests become too fast 2020-12-17 22:11:03 +03:00
Alexey Milovidov
3060743b9f Merge branch 'master' into boringssl2 2020-12-17 22:09:30 +03:00
Alexey Milovidov
0e0a66b03b Remove unsupported ciphers 2020-12-17 22:09:27 +03:00
alexey-milovidov
dd78c9dc75
Merge pull request #17566 from ClickHouse/relax-too-many-parts-1
Relax "Too many parts" threshold, part 1
2020-12-17 20:44:44 +03:00
Anton Popov
a77acd5aa7
Fix flaky test 2020-12-17 18:12:24 +03:00
hexiaoting
cb91d64fe7
Add new feature: limit length and offset setting (#17633)
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
2020-12-17 17:16:14 +03:00
Alexander Tokmakov
52ef4289fe enable optimize_on_insert for MaterializeMySQL 2020-12-17 16:05:38 +03:00
Nikita Mikhaylov
0f3582883c
Merge pull request #18147 from kitaisreal/array-aggregation-big-integer-types-support
Added array aggregation big integer types support
2020-12-17 15:44:55 +03:00
Nikita Mikhaylov
d302685e72
Merge pull request #18172 from nikitamikhaylov/julian-day-msan
toModifiedJulianDayOrNull msan fix
2020-12-17 15:12:05 +03:00
alesapin
fa266790b4 Better test 2020-12-17 14:29:29 +03:00
tavplubix
7e73b6acd8
Merge pull request #17642 from filimonov/detach-permanently
DETACH TABLE PERMANENTLY
2020-12-17 14:26:51 +03:00
alesapin
b6bd84df84 One more test for watches 2020-12-17 14:25:59 +03:00
Kruglov Pavel
d82c23d5cf
Merge pull request #16853 from amosbird/ss
Add -SimpleState combinator
2020-12-17 14:00:05 +03:00
Vitaly Baranov
da18af96a3 Fix access rights required for the merge() table function. 2020-12-17 12:29:07 +03:00
Vitaly Baranov
72df75fc50 Add tests. 2020-12-17 11:42:25 +03:00
Vitaly Baranov
af3ccb49f1 Show create query for temporary tables in system.tables 2020-12-17 11:42:25 +03:00
Vitaly Baranov
d7a3cc8c90 Don't show the "_temporary_and_external_tables" database in system tables
system.databases, system.tables, system.columns.
2020-12-17 11:42:25 +03:00
alesapin
66228f4054
Merge pull request #18065 from ClickHouse/fix_watch_race_testkeeper
Remove dead list watches from TestKeeperStorage
2020-12-17 10:15:30 +03:00
jianmei zhang
1df76ad0c3 Try to fix issue #17712 for wrong importing of rows with last bad column 2020-12-17 14:23:25 +08:00
Alexey Milovidov
d5471cda52 Attempt to remove TestFlows 2020-12-17 08:10:20 +03:00
Alexey Milovidov
ce9767fc42 Remove obsolete and inefficient ciphers 2020-12-17 07:43:54 +03:00
alexey-milovidov
81c00a4e94
Merge pull request #18167 from ClickHouse/fix_checking_profile_settings_constraints
Fix `Unknown setting profile` error on attempt to set settings profile
2020-12-17 07:18:53 +03:00
alexey-milovidov
b159e15b1b
Update easy_tasks_sorted_ru.md 2020-12-17 05:50:04 +03:00
nikitamikhaylov
db362e4585 done 2020-12-17 05:27:32 +03:00
Alexey Milovidov
7abc58526a Update test 2020-12-17 04:55:07 +03:00
Alexey Milovidov
6a7c73a7bd Merge branch 'master' into insert_quorum_parallel-default 2020-12-17 04:54:17 +03:00
Alexey Milovidov
b25f126569 Added a test 2020-12-17 04:52:27 +03:00
alexey-milovidov
d2653f91e1
Merge pull request #18112 from GrigoryPervakov/join_set_s3
Use IDisk in Set and Join storages
2020-12-17 03:40:13 +03:00
alexey-milovidov
37da513c36
Merge pull request #18136 from taiyang-li/explain_ast_nonselect_query
Explain ast support nonselect querys
2020-12-17 03:35:19 +03:00
alexey-milovidov
484f20f77d
Merge pull request #18140 from ClickHouse/fix_flaky_test
Trying to fix 00620_optimize_on_nonleader_test
2020-12-17 03:34:39 +03:00
alexey-milovidov
908784a0d9
Merge pull request #18148 from ClickHouse/suppress_error_in_test
Suppress error in 00993_system_parts_race_condition_drop_zookeeper
2020-12-17 03:32:10 +03:00
Alexander Tokmakov
76e73e4e8b fix 'Unknown setting profile' error 2020-12-16 23:49:56 +03:00
Maksim Kita
5a096a75b8 Fixed issues with average 2020-12-16 23:10:40 +03:00
alesapin
1f3702ff9e Merge branch 'master' into fix_watch_race_testkeeper 2020-12-16 23:03:07 +03:00
alesapin
a999850378
Merge pull request #18130 from ClickHouse/fix_remove_column_ttl
Fix remove TTL for column
2020-12-16 22:05:16 +03:00
nikitamikhaylov
23270915d3 better 2020-12-16 21:03:39 +03:00
Alexander Kuzmenkov
170cd132da
Merge pull request #18113 from azat/tld-list-symlink-fix
Avoid using symlinks for top_level_domains
2020-12-16 20:49:43 +03:00
alexey-milovidov
b8250882ac
Merge pull request #18056 from zhangjmruc/master
Fix issue #17160 by adding show settings like '...'
2020-12-16 20:35:18 +03:00
Mikhail Filimonov
294e8bbb4e
Fix2 2020-12-16 18:16:47 +01:00
Nikolai Kochetov
d96ca3fb8d Fixing build. 2020-12-16 20:11:32 +03:00
alesapin
422467628a Merge branch 'master' into fix_watch_race_testkeeper 2020-12-16 19:45:57 +03:00
alesapin
d873439846
Merge pull request #15236 from ClickHouse/run_func_tests_in_parallel
Collect list of non-parallel test
2020-12-16 19:29:32 +03:00
alesapin
8139bab240 More relaxed check 2020-12-16 19:12:57 +03:00
alesapin
9cc6fec36c Supress error in 00993_system_parts_race_condition_drop_zookeeper 2020-12-16 19:10:46 +03:00
Maksim Kita
b82770c2ad Added array aggregation big integer types support 2020-12-16 18:47:30 +03:00
nikitamikhaylov
50c29d9ed0 better 2020-12-16 18:34:29 +03:00
Mikhail Filimonov
f14cafee51
Fix tests 2020-12-16 16:06:43 +01:00
Anton Popov
b1dc8074ef
Merge pull request #17829 from CurtizJ/merging-map
Merging data type Map #15806
2020-12-16 16:58:02 +03:00
alesapin
c15f5fba3b Fix 00620_optimize_on_nonleader_test 2020-12-16 16:16:24 +03:00
Pervakov Grigorii
4edbb42ba1 Use IDisk in Set and Join storages 2020-12-16 14:58:44 +03:00
nikitamikhaylov
0a2bda002d remove last commit 2020-12-16 14:55:33 +03:00
nikitamikhaylov
61c1db3823 skip test 2020-12-16 14:55:33 +03:00
Ilya Golshtein
fc0a1af214 doc minor changes, cleanup, krb5-user as a recommended package 2020-12-16 14:48:33 +03:00
Ilya Golshtein
7e97814859 cleanup, fixes, new submodules, ShellCommand, WriteBufferFromString 2020-12-16 14:48:33 +03:00
Ilya Golshtein
d1d657335b USE_INTERNAL_HDFS3_LIBRARY + bash lint 2020-12-16 14:48:33 +03:00
Ilya Golshtein
d9166a0645 HADOOP_SECURE_DN_USER way, kinit thread, docker capabilities 2020-12-16 14:48:33 +03:00
Ilya Golshtein
eb10948ca2 kerberized_hdfs cluster started 2020-12-16 14:48:33 +03:00
Ilya Golshtein
185ac744b1 kerberized hdfs compiled 2020-12-16 14:48:33 +03:00
alesapin
dbbe761fa1 Fix test 2020-12-16 13:23:11 +03:00