Commit Graph

5763 Commits

Author SHA1 Message Date
Sergei Trifonov
8f20085d9a
Merge pull request #48923 from ClickHouse/async-loader
Add AsyncLoader with dependency tracking and runtime prioritization
2023-05-14 15:12:39 +02:00
Alexey Milovidov
5a44dc26e7 Fixes for clang-17 2023-05-13 02:57:31 +02:00
Alexey Milovidov
12be14b195
Merge pull request #49819 from azat/fix-clock
Use CLOCK_MONOTONIC_RAW over CLOCK_MONOTONIC on Linux (fixes non monotonic clock)
2023-05-13 01:06:27 +03:00
Alexey Milovidov
efc5e69aaf
Merge pull request #49833 from HarryLeeIBM/hlee-s390x-simple-agg
Fix DefaultHash64 for s390x
2023-05-13 01:00:36 +03:00
Sergei Trifonov
a30a0d80f2
Merge branch 'master' into async-loader 2023-05-12 20:17:20 +02:00
Igor Nikonov
51c69b6fbd Comments regarding zero values in clearable hash table 2023-05-12 17:36:35 +00:00
Igor Nikonov
d3c408aaf1 ClearableHashSet w/o zero storage for StringRef 2023-05-12 16:32:23 +00:00
serxa
195eafcaed fix disable test 2023-05-12 14:51:33 +00:00
HarryLeeIBM
809fdc7b16 Fix DefaultHash64 for s390x 2023-05-12 06:00:47 -07:00
serxa
5807737804 temporarily disable JobFailure test 2023-05-12 12:02:45 +00:00
Robert Schulze
b9c185af44
Merge pull request #49678 from azat/build/llvm-16
Switch to LLVM/clang 16 (16.0.3)
2023-05-12 13:47:36 +02:00
alesapin
d147cb105c
Merge pull request #49755 from CurtizJ/fix-unit-test
Fix unit test `ExceptionFromWait`
2023-05-12 13:08:48 +02:00
Robert Schulze
922420420c
Merge pull request #49300 from ClickHouse/rs/functdocs
Introduce more fields for in-source function documentation
2023-05-12 11:36:04 +02:00
Azat Khuzhin
fa2074e67b Use CLOCK_MONOTONIC_RAW over CLOCK_MONOTONIC on Linux (fixes non monotonic clock)
There is no bug in Linux, the issue that CLOCK_MONOTONIC returns values
less then previous calls likely happens due to adjtime(3) (NTP), since
CLOCK_MONOTONIC is affected by it, and I've seen lots of slight time
modifications due to NTP on the servers. And even on my desktop (I also
have NTP enabled):

    CLOCK_MONOTONIC:     189292.803 (2 days +  4h 34m 52s)
    CLOCK_MONOTONIC_RAW: 189290.016 (2 days +  4h 34m 50s)

However on Linux there is CLOCK_MONOTONIC_RAW, it is similar to
CLOCK_MONOTONIC, but does not affected by the adjtime(3).

About performance, it is the same:

    CLOCK_MONOTONIC 10e6:     real=0m0.191s user=0m0.190s sys=0m0.000s
    CLOCK_MONOTONIC_RAW 10e6: real=0m0.191s user=0m0.191s sys=0m0.000s

Ops/s:
- AMD Threadripper: 52.3e6
- Xeon Silver 4216 2.10: 46.5e6

Fixes: c5d631ca54
Fixes: #29811 (cc @tavplubix)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-12 10:59:53 +02:00
Anton Popov
292cfe12af
Merge branch 'master' into fix-unit-test 2023-05-11 16:56:21 +02:00
Anton Popov
db52652337 fix unit test 2023-05-10 21:00:56 +00:00
Robert Schulze
9795d5403f
Merge branch 'master' into rs/msan-randomStringUTF8 2023-05-10 20:16:49 +02:00
Robert Schulze
374dbd9c39
Fix msan issue in randomStringUTF8(<uneven number>) 2023-05-10 17:49:23 +00:00
Kruglov Pavel
289af626ad
Merge branch 'master' into fiber-local-var 2023-05-10 18:21:46 +02:00
Sergei Trifonov
2169f077be
Merge branch 'master' into async-loader 2023-05-10 18:02:11 +02:00
Azat Khuzhin
a0cc5b7e47 Merge remote-tracking branch 'u/master' into build/llvm-16 2023-05-10 16:28:36 +02:00
Han Fei
d17aa828b3
Merge pull request #49361 from hanfei1991/hanfei/fiu
support named fault injection and add a simple test
2023-05-10 15:51:51 +02:00
Sergei Trifonov
0b2860d822
Merge branch 'master' into async-loader 2023-05-10 14:54:00 +02:00
avogar
a7aec49fbb Fix indents 2023-05-10 12:43:29 +00:00
avogar
10e6f5b59a Fix indents 2023-05-10 12:31:34 +00:00
avogar
0cf6b9f145 Inherit context from parent fiber 2023-05-10 12:27:13 +00:00
Han Fei
505d9be7b2 address comments 2023-05-10 13:56:17 +02:00
avogar
930c8c3043 Use own fiber local implementation 2023-05-09 18:56:09 +00:00
Azat Khuzhin
be39e8e566 Merge remote-tracking branch 'u/master' into build/llvm-16
Conflicts:
	docker/test/codebrowser/Dockerfile
2023-05-09 20:40:43 +02:00
serxa
459181568c remove not used ErrorCodes 2023-05-09 11:54:25 +00:00
Azat Khuzhin
a794177dc3 Use __powerpc64__ over __ppc64__ (clang 16 stops declaring __ppc64__)
From the release notes [1]:

    To match GCC, __ppc64__ is no longer defined on PowerPC64 targets. Use __powerpc64__ instead.

  [1]: https://releases.llvm.org/16.0.0/tools/clang/docs/ReleaseNotes.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-09 12:20:50 +02:00
Sergei Trifonov
4f9d443226
Merge branch 'master' into async-loader 2023-05-09 12:04:23 +02:00
Alexey Milovidov
a8bdb20fc4
Merge pull request #48787 from ClickHouse/background-memory-tracker
Add MemoryTracker for the background tasks [Resubmit]
2023-05-09 07:58:36 +03:00
Han Fei
64b67b9a37 Merge branch 'master' into hanfei/fiu 2023-05-09 01:14:30 +02:00
Han Fei
82ce47ce56 address comments 2023-05-08 23:02:36 +02:00
avogar
c961e3706e Clean up 2023-05-08 16:52:57 +00:00
Igor Nikonov
8bc04d5fa8
Merge pull request #49636 from ClickHouse/fix-distinct-in-order-bug-49622
Fix: DISTINCT in order with zero values in non-sorted columns
2023-05-08 18:42:38 +02:00
avogar
b320527158 Fix assert in SpanHolder::finish() with fibers 2023-05-08 16:33:39 +00:00
Alexey Milovidov
3cf1da7bf3
Merge branch 'master' into deprecate-in-memory-parts 2023-05-08 01:38:00 +03:00
Igor Nikonov
fe02317d45 Clear zero value storage only if need_zero_value_storage 2023-05-07 22:16:16 +00:00
Igor Nikonov
ba2e827aa7 Fix: check if zero storage has zeros before clean up 2023-05-07 21:31:01 +00:00
Igor Nikonov
68fcc39292 Fix: DISTINCT in order with zero values in non-sorted columns 2023-05-07 21:09:03 +00:00
Alexey Milovidov
cfb35cb251 Fix typo: "as much slots" -> "as many slots" 2023-05-07 04:42:46 +02:00
Alexey Milovidov
61f1861d70 Fix error 2023-05-06 20:54:52 +02:00
Alexey Milovidov
b1a92a5712 Remove dangerous code 2023-05-06 18:30:18 +02:00
Alexey Milovidov
7897a6cf92 Remove dangerous code (stringstream) 2023-05-06 18:14:01 +02:00
Alexey Milovidov
26d435bd66
Merge pull request #49572 from CurtizJ/fix-thread-pool-wait
Fix `ThreadPool::wait`
2023-05-06 18:15:02 +03:00
Alexey Milovidov
75a2589a42
Merge branch 'master' into deprecate-in-memory-parts 2023-05-06 00:49:59 +03:00
Han Fei
d2bd0bcd59
Merge branch 'master' into patch-1 2023-05-05 23:39:08 +02:00
Robert Schulze
45c28e1221
Introduce more fields for in-source function documentation 2023-05-05 21:30:21 +00:00
Ilya Yatsishin
df8c563371
Merge pull request #49538 from ClickHouse/no-prctl-is-ok
Allow to run in Linux without PRCTL support
2023-05-05 21:19:38 +02:00
Anton Popov
223adc1725 fix ThreadPool::wait 2023-05-05 19:14:45 +00:00
Nikolay Degterinsky
7a727bbbe3
Merge pull request #49520 from IvanTakarlikov-st/it-grammar-fixes
Fix some grammar mistakes in documentation, code and tests
2023-05-05 15:45:58 +02:00
Han Fei
9c19bd8179
Merge branch 'master' into patch-1 2023-05-05 14:41:40 +02:00
Kseniia Sumarokova
478542c6d7
Update ErrorCodes.cpp 2023-05-05 13:56:10 +02:00
Kseniia Sumarokova
221796e053
Merge branch 'master' into allow-to-get-current-az 2023-05-05 13:55:14 +02:00
Anton Popov
c87a6e8e7d
Merge pull request #49117 from CurtizJ/limit-mutations
Add settings to delay or throw in case of too many mutations
2023-05-05 12:18:57 +02:00
Bulat Gaifullin
3fe8c9e6ed
Remove extra semicolumns 2023-05-05 11:54:11 +03:00
Sergei Trifonov
f6c433cdd2
Merge pull request #49521 from ClickHouse/serxa-patch-3 2023-05-05 08:28:55 +02:00
Alexey Milovidov
09f171822e Merge branch 'master' into deprecate-in-memory-parts 2023-05-05 06:43:23 +02:00
Alexey Milovidov
efa66521de Allow to run in Linux without PRCTL support 2023-05-05 06:40:12 +02:00
Alexey Milovidov
38b2f94bfa
Merge pull request #49476 from ClickHouse/minor-changes
Minor changes for setThreadName
2023-05-05 04:02:30 +03:00
Sergei Trifonov
f4b3f1eb28
Fix UserTimeMicroseconds and SystemTimeMicroseconds descriptions 2023-05-04 19:40:41 +02:00
Ivan Takarlikov
8873856ce5 Fix some grammar mistakes in documentation, code and tests 2023-05-04 13:35:18 -03:00
Dmitry Novik
befcdbcc6d
Merge pull request #47630 from ClickHouse/revert-47476-revert_46622
Fix user MemoryTracker counter in async inserts
2023-05-04 16:57:41 +02:00
Anton Popov
e61d7baa54 Merge remote-tracking branch 'upstream/master' into HEAD 2023-05-04 14:03:53 +00:00
Alexander Tokmakov
b5a57da4ce
Merge pull request #49316 from ClickHouse/rs/48385
Unpoison stack frame ptrs from libunwind for msan
2023-05-04 16:17:30 +03:00
alesapin
412b161104
Merge pull request #48791 from kssenii/better-local-object-storage
Make local object storage work consistently with s3 object storage, fix problem with append, make it configurable as independent storage
2023-05-04 11:47:43 +02:00
Alexey Milovidov
261907c143 Merge branch 'master' into deprecate-in-memory-parts 2023-05-04 01:07:38 +02:00
Alexey Milovidov
50202c1b0a Minor changes 2023-05-03 22:51:56 +02:00
serxa
5c3e9b9e85 fix style 2023-05-03 18:58:17 +00:00
serxa
94dca90219 do not polute unit test output 2023-05-03 18:43:29 +00:00
serxa
90a5695029 add AsyncLoader introspection 2023-05-03 18:19:32 +00:00
Nikita Mikhaylov
954e3b724c
Speedup outdated parts loading (#49317) 2023-05-03 18:56:45 +02:00
kssenii
0a18a87ad3 Fix style check 2023-05-03 18:28:33 +02:00
Nikolay Degterinsky
048b4ec738
Merge branch 'master' into bcrypt 2023-05-03 16:14:57 +02:00
Sergei Trifonov
356bb15e96
Update src/Common/AsyncLoader.h
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2023-05-03 15:43:52 +02:00
Sergei Trifonov
eeedc5d3e7
Update src/Common/AsyncLoader.h
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2023-05-03 15:43:31 +02:00
Sergei Trifonov
5f2e6fae22
Update src/Common/AsyncLoader.h
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2023-05-03 15:42:18 +02:00
Sergei Trifonov
eca52c4015
Update src/Common/AsyncLoader.cpp
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2023-05-03 15:41:12 +02:00
Azat Khuzhin
ad69fbb972
Fix compiling average example (suppress -Wframe-larger-than) (#49358) 2023-05-03 13:32:34 +02:00
alesapin
6f3f202f7c
Merge branch 'master' into fix_zero_copy_not_atomic 2023-05-03 12:53:35 +02:00
Vladimir C
65ab64a77f
Merge pull request #49418 from ClickHouse/vdimir/keeper_fault_inject_sequential_cleanup 2023-05-03 12:27:10 +02:00
Alexey Milovidov
f449df85b6 Deprecate in-memory parts 2023-05-03 00:31:09 +02:00
Nikolay Degterinsky
4c038ef538
Merge branch 'master' into bcrypt 2023-05-02 21:52:21 +02:00
Dmitry Novik
bab112a1bc
Merge branch 'master' into revert-47476-revert_46622 2023-05-02 20:54:25 +02:00
vdimir
33cf697028
Correctly cleanup sequential node in ZooKeeperWithFaultInjection 2023-05-02 15:01:59 +00:00
Robert Schulze
cf884d29a1
Merge remote-tracking branch 'origin/master' into rs/48385 2023-05-02 13:43:36 +00:00
Robert Schulze
ee49f8f0fa
Fix clang-tidy build 2023-05-02 13:41:38 +00:00
Antonio Andelic
f695040a19
Merge pull request #48897 from ClickHouse/keeper-check-not-exists
Add `CheckNotExists` request to Keeper
2023-05-02 13:14:22 +02:00
serxa
f3b97f9d1f improve helper functions 2023-05-02 09:19:27 +00:00
Ziy1-Tan
c93ceedbef Fix style
Signed-off-by: Ziy1-Tan <ajb459684460@gmail.com>
2023-05-02 10:38:37 +08:00
Han Fei
d608ba41e7 try to fix 2023-05-02 00:05:36 +02:00
Robert Schulze
3d467febe0
Fix build 2023-05-01 20:58:10 +00:00
Han Fei
4d18a4f8d3
Merge branch 'master' into hanfei/fiu 2023-05-01 17:51:41 +02:00
Han Fei
b701293d46 support named fault injection and add a simple test 2023-05-01 17:44:37 +02:00
Ziy1-Tan
967951cab7 Improve error message for function url 2023-05-01 21:40:30 +08:00
serxa
18d7aa345a fix 2023-05-01 12:26:37 +00:00
serxa
05477046c3 more helpers for AsyncLoader 2023-05-01 12:09:22 +00:00
serxa
75021138ed schedule() jobs recursively with its dependencies 2023-05-01 12:09:10 +00:00