Commit Graph

1527 Commits

Author SHA1 Message Date
Alexey Milovidov
13a129bee7 Merge branch 'master' into remove-useless-line 2022-09-04 03:24:40 +02:00
alesapin
6815d79102
Merge pull request #40591 from ClickHouse/util-self-extracting-singl
Self-extracting: fix possible race condition
2022-09-02 12:26:01 +02:00
Antonio Andelic
e64436fef3 Fix typos with new codespell 2022-09-02 08:54:48 +00:00
alesapin
9d64e5f902
Merge branch 'master' into util-self-extracting-singl 2022-09-01 17:38:24 +02:00
robot-clickhouse
5309831a1a Update version_date.tsv and changelogs after v22.8.4.7-lts 2022-08-31 14:32:54 +00:00
Alexander Tokmakov
6a50c20734
Merge branch 'master' into zookeeper_client_fault_injection 2022-08-30 15:43:30 +03:00
Yakov Olkhovskiy
a9cab86a73 typo 2022-08-30 01:46:17 +00:00
Yakov Olkhovskiy
7a85a943f1 fix close lock on exec, refactoring, comments added 2022-08-30 01:11:04 +00:00
robot-clickhouse
92c14e80f1 Update version_date.tsv and changelogs after v22.3.12.19-lts 2022-08-29 14:52:19 +00:00
Alexander Tokmakov
8bdb589c2b Merge branch 'master' into zookeeper_client_fault_injection 2022-08-29 13:34:57 +02:00
Azat Khuzhin
35f5e56159 Update aspell-dict to fix doc check
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-29 00:27:19 +02:00
Alexey Milovidov
fc68e09554 Fix style 2022-08-28 22:15:09 +02:00
Alexey Milovidov
deac6cfb5d Minor modifications 2022-08-28 20:49:39 +02:00
Yakov Olkhovskiy
ae82c68725 truncate lock 2022-08-25 10:52:56 +00:00
vdimir
f0c13b0531
Add CurrentMetrics::Value to check-style 2022-08-25 09:31:22 +00:00
Yakov Olkhovskiy
6c1a7205e3 fix style 2022-08-24 21:47:37 +00:00
Yakov Olkhovskiy
f043d03053 fix style 2022-08-24 21:28:52 +00:00
Yakov Olkhovskiy
6afd9c176b inode based singleton 2022-08-24 21:05:00 +00:00
robot-clickhouse
274f3dbb95 Update version_date.tsv and changelogs after v22.7.4.16-stable 2022-08-23 19:13:49 +00:00
Yakov Olkhovskiy
d11d494587
Merge pull request #40426 from ClickHouse/util-compressor-exec
Self-extracting: add --exec param, allow compressed to be renamed
2022-08-23 11:20:28 -04:00
Yakov Olkhovskiy
088a969500 comments added 2022-08-22 12:14:29 +00:00
Yakov Olkhovskiy
47d5a64f13 fix style 2022-08-21 22:06:11 +00:00
Yakov Olkhovskiy
32717a844e allow empty --exec to signify no executable to run, add some stats printout 2022-08-21 21:39:24 +00:00
Yakov Olkhovskiy
5be782a7e6 fix buffer overflow 2022-08-20 21:02:36 +00:00
Alexey Milovidov
74e1f4dc61 Fix clang-tidy 2022-08-20 17:09:20 +02:00
Yakov Olkhovskiy
d4facec3fa typo 2022-08-20 14:03:03 +00:00
Yakov Olkhovskiy
151afb16e2 add EOL 2022-08-19 20:57:12 +00:00
Yakov Olkhovskiy
d81ec25027 add --exec param, allow compressed to be renamed 2022-08-19 20:43:10 +00:00
robot-clickhouse
a9b3df37dd Update version_date.tsv and changelogs after v22.8.1.2097-lts 2022-08-18 17:45:23 +00:00
Alexander Tokmakov
ae000e9125
Merge branch 'master' into zookeeper_client_fault_injection 2022-08-17 12:48:54 +03:00
Alexander Tokmakov
c9bb91c31f
Merge pull request #40232 from ClickHouse/fix_a_bug_with_symlinks_detection
Fix a bug with symlinks detection
2022-08-15 20:28:30 +03:00
Alexander Tokmakov
6f5a7c3bf7 fix a bug with symlinks detection 2022-08-15 12:30:47 +02:00
Alexey Milovidov
ce2155cf79 Remove old code 2022-08-14 05:40:48 +02:00
Alexander Gololobov
ef6ff51b9a
Merge pull request #40147 from azat/fix-keeper-bench
Fix keeper-bench in case of error during scheduling a thread
2022-08-12 21:10:36 +02:00
Kseniia Sumarokova
a6cfc7bc3b
Merge pull request #34651 from alexX512/master
New caching strategies
2022-08-12 17:23:37 +02:00
Azat Khuzhin
d3e8ad9e7e Fix keeper-bench in case of error during scheduling a thread
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-12 10:56:11 +02:00
Mikhail f. Shiryaev
5934c6519f
Regenerate changelogs and update versions 2022-08-11 00:06:01 +02:00
Alexey Milovidov
ffde0d9530 Fix broken image in test-visualizer 2022-08-10 04:46:43 +02:00
robot-clickhouse
94fd85d586 Update version_date.tsv and changelogs after v22.6.5.22-stable 2022-08-09 18:32:28 +00:00
Kruglov Pavel
99b9e85a8f
Merge pull request #39646 from Avogar/more-formats
Add more Pretty formats
2022-08-09 13:59:47 +02:00
Yakov Olkhovskiy
2c3732ed3a extract real path of executable instead of argv[0] 2022-08-08 17:56:16 -04:00
alexX512
8adf9f2448 fix compile error 2022-08-07 19:59:39 +00:00
alexX512
77def20394 Fix typos in some js code and ignore some typos 2022-08-07 19:59:39 +00:00
Yakov Olkhovskiy
9dfd650a7c
Merge pull request #39763 from ClickHouse/util-self-extracting-exec
Self-extracting - run resulting executable with execvp
2022-08-05 08:13:15 -04:00
Alexey Milovidov
f474eb957d
Merge pull request #39758 from ClickHouse/tsan_clang_15
Try clang-15 for build with tsan
2022-08-04 01:56:52 +03:00
Yakov Olkhovskiy
ba86959b72 Merge branch 'util-self-extracting-exec' of https://github.com/ClickHouse/ClickHouse into util-self-extracting-exec 2022-08-03 13:15:06 -04:00
Yakov Olkhovskiy
53530a5fa4 deadcode/clang-tidy fight solution 2022-08-03 13:11:11 -04:00
robot-clickhouse
58fc49df66 Update version_date.tsv after v22.3.10.22-lts 2022-08-03 14:53:22 +00:00
Mikhail f. Shiryaev
c05526beef
Merge remote-tracking branch 'origin/master' into auto/v22.7.2.15-stable 2022-08-03 12:04:34 +02:00
Mikhail f. Shiryaev
2ca9df9b22
Merge pull request #39421 from ClickHouse/github-helper
GitHub helper
2022-08-03 12:04:03 +02:00
robot-clickhouse
da655fbfcf Update version_date.tsv and changelogs after v22.7.2.15-stable 2022-08-03 09:57:02 +00:00
Yakov Olkhovskiy
5a5d028154
remove global variables 2022-08-03 03:34:51 -04:00
Alexey Milovidov
80d2685ab7
Merge pull request #39814 from qianmoQ/fix-cte
Support cte statement for antlr4 syntax file #39810
2022-08-03 09:10:08 +03:00
Yakov Olkhovskiy
504180d7d6
stat is different for macos 2022-08-02 15:39:11 -04:00
Alexander Tokmakov
82b50e79cf
Merge branch 'master' into tsan_clang_15 2022-08-02 13:00:55 +03:00
qianmoQ
094b28b869 Support cte statement for antlr4 syntax file #39810 2022-08-02 17:17:08 +08:00
Alexander Tokmakov
ecf7ce1f74 Merge branch 'master' into zookeeper_client_fault_injection 2022-08-01 20:49:01 +02:00
Yakov Olkhovskiy
e65cef79ad some refactoring 2022-08-01 14:32:32 -04:00
Yakov Olkhovskiy
8820774fe3 do not rename original file - just remove 2022-08-01 13:39:26 -04:00
Alexander Tokmakov
0d68b1c67f fix build with clang-15 2022-08-01 18:00:54 +02:00
Yakov Olkhovskiy
2a074288f0 style fix 2022-08-01 11:06:54 -04:00
Yakov Olkhovskiy
c79893f4ef remove call to sh, use random names suffix for temporaries 2022-08-01 10:58:08 -04:00
Kruglov Pavel
7bbc6c7292
Update aspell-dict.txt 2022-08-01 13:00:44 +02:00
Yakov Olkhovskiy
3aeb525036 style fix 2022-08-01 01:45:02 -04:00
Yakov Olkhovskiy
7a2d969850 fix clang tidy unused return 2022-08-01 01:20:40 -04:00
Yakov Olkhovskiy
c534bdd42f clang tidy treats call to system as security issue - replace with fork/exec 2022-08-01 01:13:50 -04:00
Yakov Olkhovskiy
3731a415e6 run resulting executable with execvp 2022-07-31 20:07:33 -04:00
Azat Khuzhin
498c8b3c52 Fix clang-tidy in utils/examples
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-29 11:36:51 +03:00
Azat Khuzhin
83dfbe3b9a Fix building keeper-data-dumper
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-29 11:36:51 +03:00
Alexey Milovidov
69e8e56072
Merge pull request #39578 from ClickHouse/fix-self-executable-leak
free compression and decompression contexts
2022-07-26 07:47:32 +03:00
Mikhail f. Shiryaev
c150fe6f0d
Fix possible wrong FROM_REF by using merge-base commit 2022-07-25 21:56:20 +02:00
robot-clickhouse
f04ad30f0d Update version_date.tsv and changelogs after v22.6.4.35-stable 2022-07-25 19:25:27 +00:00
Yakov Olkhovskiy
250f19378d free compression and decompression contexts 2022-07-25 15:22:48 -04:00
Yakov Olkhovskiy
d0f5dcad25
Merge pull request #38936 from ClickHouse/cmake-self-extracting-executable
Build self-extracting-executable utils
2022-07-25 08:13:25 -04:00
Yakov Olkhovskiy
a85818f654 some refactoring 2022-07-24 21:13:00 -04:00
Mikhail f. Shiryaev
3e0db34ed9
Merge pull request #39390 from ClickHouse/paint-it-black
Automatic fixes for black formatting for domestic repo PRs
2022-07-22 17:19:00 +02:00
Robert Schulze
99579ab440
Merge pull request #39364 from ClickHouse/stringref-to-string_view
Even less usage of StringRef
2022-07-22 09:30:49 +02:00
Alexey Milovidov
63d37fd440
Merge pull request #39475 from ClickHouse/auto/v22.7.1.2484-stable
Update version_date.tsv and changelogs after v22.7.1.2484-stable
2022-07-22 06:40:40 +03:00
robot-clickhouse
e6ff5744e0 Update version_date.tsv and changelogs after v22.7.1.2484-stable 2022-07-21 17:47:00 +00:00
Yakov Olkhovskiy
5071295a6a mount.h for OS_FREEBSD 2022-07-21 11:43:00 -04:00
Mikhail f. Shiryaev
f60dcc30fb
Push automatic fix for black format for PRs 2022-07-21 17:01:42 +02:00
Yakov Olkhovskiy
c8ea6783dc clang tidy suggestions 2022-07-21 10:27:56 -04:00
Yakov Olkhovskiy
15496c63b9 __APPLE__->OS_DARWIN, __FreeBSD__->OS_FREEBSD 2022-07-21 10:14:53 -04:00
Mikhail f. Shiryaev
dd2a0ed755
Improve speed significantly by using cached users and reuse repos 2022-07-21 15:46:39 +02:00
Alexey Milovidov
ad77b84b82 Update changelog 2022-07-21 13:32:34 +02:00
Mikhail f. Shiryaev
aef212d552
Add ref commits to the chengelog headers 2022-07-21 09:00:31 +02:00
Yakov Olkhovskiy
bdd11f671d different path of endian.h for FreeBSD 2022-07-21 02:08:07 -04:00
Yakov Olkhovskiy
e7438cc433
Merge branch 'master' into cmake-self-extracting-executable 2022-07-21 00:25:08 -04:00
Yakov Olkhovskiy
29ed2083d1 endian.h in different path on __APPLE__ and __FreeBSD__ 2022-07-21 00:20:23 -04:00
Yakov Olkhovskiy
b766552481 add native build for cross-compilation 2022-07-20 23:09:05 -04:00
Mikhail f. Shiryaev
59501150d0
Use github_helper in changelog, use a robot token in CI 2022-07-20 17:28:46 +02:00
Robert Schulze
81ef1099cc
Even less usage of StringRef
--> see #39300
2022-07-19 07:01:06 +00:00
Jordi Villar
c63512d255 Use CH custom platform macro for OS Darwin 2022-07-18 09:59:02 +02:00
Jordi Villar
d86abba2c6 Fix macosx compilation due to endian.h 2022-07-17 14:58:27 +02:00
Yakov Olkhovskiy
e5f165d909
Merge branch 'master' into cmake-self-extracting-executable 2022-07-13 16:09:18 -04:00
Yakov Olkhovskiy
2079699f75
Merge pull request #39065 from ClickHouse/utils-self-extracting-decompressor
Parameter --decompressor added to utils/self-extracting-executable/compressor
2022-07-13 01:50:12 -04:00
Alexey Milovidov
e2684447b4
Merge pull request #38437 from ClickHouse/compatible-benchmark
Compatible and reproducible DBMS benchmark
2022-07-12 21:15:53 +03:00
Yakov Olkhovskiy
7c437c3f9b some optimizations 2022-07-12 09:56:09 -04:00
Alexey Milovidov
87ebf51cdc Fix style 2022-07-11 22:26:50 +02:00
Robert Schulze
c2e4fde0e2
Link only necessessary stuff for self-extracting-executable 2022-07-11 19:48:49 +02:00
Robert Schulze
1a7727a254
Prefix overridden add_executable() command with "clickhouse_"
A simple HelloWorld program with zero includes except iostream triggers
a build of ca. 2000 source files. The reason is that ClickHouse's
top-level CMakeLists.txt overrides "add_executable()" to link all
binaries against "clickhouse_new_delete". This links against
"clickhouse_common_io", which in turn has lots of 3rd party library
dependencies ... Without linking "clickhouse_new_delete", the number of
compiled files for "HelloWorld" goes down to ca. 70.

As an example, the self-extracting-executable needs none of its current
dependencies but other programs may also benefit.

In order to restore access to the original "add_executable()", the
overriding version is now prefixed. There is precedence for a
"clickhouse_" prefix (as opposed to "ch_"), for example
"clickhouse_split_debug_symbols". In general prefixing makes sense also
because overriding CMake commands relies on undocumented behavior and is
considered not-so-great practice (*).

(*) https://crascit.com/2018/09/14/do-not-redefine-cmake-commands/
2022-07-11 19:36:18 +02:00
Yakov Olkhovskiy
3432768dc3 Parameter --decompressor added, architecture-agnostic metadata, bugs fixed, some improvements 2022-07-09 16:05:12 -04:00
Azat Khuzhin
53d019a94b check-style: improve ZooKeeper path check for Replicated.*MergeTree tables
- detech all Replicated.*MergeTree tables
- allow default_path_test/uuid in zookeeper path
- improve pattern for filtering tests

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-08 13:19:24 +03:00
robot-clickhouse
7cef35da70 Update version_date.tsv after v22.4.6.53-stable 2022-07-07 20:05:14 +00:00
Yakov Olkhovskiy
c6db15458a build utils/self-extracting-executable/compressor whenever we want to build compressed binary 2022-07-06 20:40:41 -04:00
Robert Schulze
ee19c218f3
Teach ClickHouse's spellcheck "ClickHouse's" 2022-07-05 14:24:18 +02:00
alesapin
bd8a3ee841
Merge pull request #38338 from ClickHouse/zookeeper-add-extra-list-argument
Extend ZooKeeper list request with support for filtering persistent or ephemeral nodes only
2022-07-05 12:53:51 +02:00
Kruglov Pavel
4080f055b6
Merge pull request #38477 from Avogar/sql-insert-format
Add SQLInsert output format
2022-07-04 15:06:33 +02:00
Mikhail f. Shiryaev
7a58a8c19b
Merge pull request #38647 from ClickHouse/clickhouse-diagnostics
Clickhouse diagnostics
2022-07-04 12:14:33 +02:00
Mikhail f. Shiryaev
446ead1af4
Fix typos issues it clickhouse-diagnostics 2022-07-04 10:59:39 +02:00
Azat Khuzhin
e4b81e6de9 Add exp_internal for expect tests
This is to catch possible issues like 01565_reconnect_after_client_error in [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/38417/e33f236d502fe9f7906392f4ceffaee44e3c4ce4/stateless_tests__thread__actions__[3/3].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-02 17:08:06 +03:00
robot-clickhouse
656d0c0f04 Update version_date.tsv and changelogs after v22.6.2.12-stable 2022-06-29 11:24:30 +00:00
mergify[bot]
9482c99ab8
Merge branch 'master' into sql-insert-format 2022-06-29 11:03:07 +00:00
Antonio Andelic
7a8fbbf132 Merge branch 'master' into zookeeper-add-extra-list-argument 2022-06-29 08:31:03 +00:00
Robert Schulze
c22038d48b
More clang-tidy fixes 2022-06-28 11:50:05 +00:00
avogar
3b4ecc93bc Fix test and style 2022-06-28 10:48:20 +00:00
Mikhail f. Shiryaev
1b945307ea
Merge pull request #38238 from ClickHouse/changelog-attrs
Changelog attrs
2022-06-27 14:30:19 +02:00
Antonio Andelic
c06776ce0d Merge branch 'master' into zookeeper-add-extra-list-argument 2022-06-27 06:53:29 +00:00
San
cbcf515306
Update SECURITY.md.sh
Update Security.md generation code to include bugcrowd program information.
2022-06-27 12:06:16 +10:00
Robert Schulze
2c828338f4
Replace hyperscan by vectorscan
This commit migrates ClickHouse to Vectorscan. The first 10 min of
[0] explain the reasons for it.

(*) Addresses (but does not resolve) #38046

(*) Config parameter names (e.g. "max_hyperscan_regexp_length") are
    preserved for compatibility. Likewise, error codes (e.g.
    "ErrorCodes::HYPERSCAN_CANNOT_SCAN_TEXT") and function/class names (e.g.
    "HyperscanDeleter") are preserved as vectorscan aims to be a drop-in
    replacement.

[0] https://www.youtube.com/watch?v=KlZWmmflW6M
2022-06-24 10:47:52 +02:00
Antonio Andelic
3a71b63b5d Add list request type 2022-06-23 10:28:12 +00:00
Mikhail f. Shiryaev
d2f3c5b836
Add sleeping after received second rate limit exceeded 2022-06-23 12:13:07 +02:00
Robert Schulze
fa6deaa0f7
Merge pull request #38294 from ClickHouse/fix_system_dot_licences_on_mac
Fix system.licenses on mac
2022-06-23 09:33:07 +02:00
Mikhail f. Shiryaev
779b83262f
Add not for changelog category with titles as entries 2022-06-22 23:50:38 +02:00
Mikhail f. Shiryaev
3ab58fd14f
Add docusaurus header to generated changelogs 2022-06-22 23:47:53 +02:00
Robert Schulze
ec7ef2686b
P -> D (should fix test "01276_system_licenses") 2022-06-22 09:21:12 +00:00
Robert Schulze
287a7f6e98
Let CMake check the presence of GNU utils
In list-licenses.sh it's too late ... the build simply continues if
list-licenses.sh returns with a non-zero exit code.
2022-06-21 23:49:29 +02:00
Robert Schulze
76bd2533a3
Fix system.licenses on mac
- list-licenses.sh assumed GNU versions (e.g. the "-printf" flag of
  find) but Mac ships with a non-GNU version

- this led to error

  [8677/8942] Generating StorageSystemLicenses.generated.cpp
  find: -printf: unknown primary or operator
  find: -printf: unknown primary or operator
  find: -printf: unknown primary or operator
  find: -printf: unknown primary or operator

  during build and as a result, an empty system.licenses table

- As a fix, force the GNU versions of find and grep on Mac
2022-06-21 23:22:27 +02:00
Sergei Trifonov
0a14f3168d
Merge pull request #38287 from ClickHouse/trace-viz-fix
fix trace-viz zoom anomalies
2022-06-21 20:59:35 +02:00
Sergei Trifonov
56a3fc5401 fix trace-viz zoom anomalies 2022-06-21 20:04:52 +02:00
robot-clickhouse
4996236430 Update version_date.tsv after v22.3.7.28-lts 2022-06-20 14:41:14 +00:00
Sergei Trifonov
c0a275984f
Merge pull request #38169 from ClickHouse/trace-visualizer
improve trace-visualizer UX
2022-06-20 12:05:38 +02:00
Alexey Milovidov
457f49a43e Add a word into spelling dictionary 2022-06-19 05:58:45 +02:00
Sergei Trifonov
85dd3afa2b more improvements 2022-06-17 18:02:03 +02:00
Sergei Trifonov
1d9bcb5993 improve trace-visualizer UX 2022-06-17 09:30:08 +02:00
Mikhail f. Shiryaev
7ac4b9b935
New changelog and versions updated 2022-06-16 17:37:41 +02:00
Alexey Milovidov
c737bc2bcf
Update README.md 2022-06-16 12:41:02 +03:00
Alexey Milovidov
d9e558720f Fix typos 2022-06-16 11:38:54 +02:00
Alexey Milovidov
cf6f865f80
Revert "Revert "add d3js based trace visualizer as gantt chart"" 2022-06-16 12:35:13 +03:00
Robert Schulze
8fef6e7fa3
Add missing ":" to error msg 2022-06-15 14:37:58 +02:00
Robert Schulze
50748a94bd
Fix a compile errors in self-extracting-executable (de)compressor
E.g.

utils/self-extracting-executable/compressor.cpp:257:31: format specifies type 'ptrdiff_t' (aka 'long') but the argument has type 'off_t' (aka 'long long') [-Werror,-Wformat]
        printf("Size: %td\n", info_in.st_size);
                      ~~~     ^~~~~~~~~~~~~~~
                      %lld

Not sure though if it's a hard requirement to use only C.

Avoided usage of fmt::format() to keep link dependencies to a minimum.
Also not using C++20 std::format() as it's only available in Clang >=14.
2022-06-15 13:41:28 +02:00
Alexander Tokmakov
afc3f1858b
Revert "add d3js based trace visualizer as gantt chart" 2022-06-14 11:27:49 +03:00
Sergei Trifonov
94b33498ae
Merge pull request #37810 from ClickHouse/trace-d3-gantt 2022-06-14 07:41:48 +02:00
Yakov Olkhovskiy
539100fc4a some refactoring, cleaning, types fixed in fprintf 2022-06-13 20:25:19 -04:00
Yakov Olkhovskiy
ce395dc68d resolving conflicts 2022-06-13 11:41:32 -04:00
xiedeyantu
9f4489ac03
Fix MacOS build faild (#38007) 2022-06-13 12:14:21 +02:00
Yakov Olkhovskiy
0bae6c037a bugs fixed, process EINTR, rename to self-extracting-executable 2022-06-12 23:27:56 -04:00
KinderRiven
18f8f6c61e fix 2022-06-12 17:31:33 +08:00
KinderRiven
b456f657b3 fix 2022-06-12 13:24:08 +08:00
KinderRiven
160e5aa91a fix 2022-06-12 13:23:27 +08:00