thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-27 10:02:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
35,817 Commits 9,196 Branches 1,782 Tags 2.1 GiB
852fcdee6f
Commit Graph

25542 Commits

Author SHA1 Message Date
Nikita Mikhaylov
24cbd0d6d1 squashed commits 2020-02-19 18:01:08 +03:00
alesapin
1914b1dab7 Add missed headers 2020-02-19 17:58:06 +03:00
Pavel Kovalenko
d4fa60f52d Rename disk_name -> disk. 2020-02-19 17:50:39 +03:00
alesapin
6020f2fd4a Remove redundant function 2020-02-19 17:50:11 +03:00
alesapin
d5b4ddf6d8 Simplier alter modify logic 2020-02-19 17:49:59 +03:00
alesapin
28b2a03b08 First version 2020-02-19 17:49:45 +03:00
chertus
9f43fa87c3 make switched flag atomic 2020-02-19 17:23:21 +03:00
Nikolai Kochetov
3bfbd26901 Use processors for sending external tables. 2020-02-19 17:00:49 +03:00
Alexey Milovidov
add281dfe3 Enable metric_log by default 2020-02-19 16:39:20 +03:00
Nicolae Vartolomei
811197558c Improve stack trace formatting for Poco and std exceptions 
Before:

```
<Error> Application: Caught exception while loading metadata: Poco::Exception. Code: 1000, e.code() = 0, e.displayText() = Access to file denied: boo0. /home/nv/clickhouse-master-clion/contrib/poco/Foundation/src/Exception.cpp:27: Poco::FileAccessDeniedException::FileAccessDeniedException(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0xbb598cc in /state/home/nv/clickhouse-builds/clickhouse-master-clion-gcc/dbms/programs/clickhous
```

After:

```
<Error> Application: Caught exception while loading metadata: Poco::Exception. Code: 1000, e.code() = 0, e.displayText() = Access to file denied: boo, Stack trace (when copying this message, always include the lines below):

0. /home/nv/clickhouse-master-clion/contrib/poco/Foundation/src/Exception.cpp:27: Poco::FileAccessDeniedException::FileAccessDeniedException(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0xbb5987c in /state/home/nv/clickhouse-builds/clickhouse-master-clion-gcc/dbms/programs/clickhous
```
 2020-02-19 13:33:31 +00:00
chertus
1c297412d4 fix test 2020-02-19 16:10:03 +03:00
alesapin
3b4c27b0de Fix remove parts from mutations 2020-02-19 15:55:23 +03:00
chertus
3348697128 fix storage join 2020-02-19 15:37:56 +03:00
Nikolai Kochetov
75af5414d9 Try fix test_delayed_replica_failover 2020-02-19 15:30:56 +03:00
chertus
48ac7d35ae Merge branch 'master' into joins 2020-02-19 14:21:40 +03:00
chertus
f748427ffd minor fix (remove logic dependent on partial_merge_join setting) 2020-02-19 14:20:35 +03:00
Pavel Kovalenko
d662c1e006 Merge branch 'master' into storage-stripe-log-s3 2020-02-19 13:24:23 +03:00
Nikolai Kochetov
4fa6c86114 Fix StorageHDFS. 2020-02-19 13:22:44 +03:00
Nikolai Kochetov
70a7ddc172 Fix StorageURL 2020-02-19 13:17:49 +03:00
alexey-milovidov
b063dbeaf2
Merge pull request #8598 from excitoon-favorites/passttlsoverhttp 
Pass TTL rule info with block to other replicas
 2020-02-19 12:09:25 +03:00
alexey-milovidov
c5d5c9c11e
Merge pull request #9192 from nvartolomei/nv/format-version-file-typo 
Fix typo in file name when reporting version file duplicates
 2020-02-19 11:59:22 +03:00
alexey-milovidov
1c66c2f383
Merge pull request #9201 from CurtizJ/fix-range-reader 
Fix mistake introduced in #9050.
 2020-02-19 11:58:21 +03:00
alexey-milovidov
ebf4f98a0c
Merge pull request #9210 from Felixoid/profiling_docs 
Add description for some profiling events
 2020-02-19 11:55:52 +03:00
alexey-milovidov
77f9a358ff
Update ProfileEvents.cpp 2020-02-19 11:55:29 +03:00
alexey-milovidov
e90124dc24
Update ProfileEvents.cpp 2020-02-19 11:54:23 +03:00
Mikhail f. Shiryaev
fdc00e3562
Add description for some profiling events 2020-02-19 09:50:58 +01:00
Alexey Milovidov
b2a52a2d69 Remove useless code #9210 2020-02-19 11:49:26 +03:00
alexey-milovidov
9037a5d29a
Suggestion from Azat 2020-02-19 11:27:57 +03:00
CurtizJ
dea444b69c fix mistake in MergeTreeDataSelectExecutor 2020-02-19 00:00:51 +03:00
Pavel Kovalenko
ff50a51757 Formatting issues. 2020-02-18 22:13:37 +03:00
chertus
74a5227ac4 add join_algorithm setting 2020-02-18 20:31:22 +03:00
Nikolai Kochetov
69a38958b4 fix PVS warning. 2020-02-18 19:23:29 +03:00
Pavel Kovalenko
05ceef4ef8 Log family storages disk support via 'SETTINGS' clause. 2020-02-18 17:41:30 +03:00
Nikolai Kochetov
3f55e6a499 Processors support for StorageFromMergeTreeDataPart reading. 2020-02-18 17:24:33 +03:00
chertus
fbecd0c155 use default_max_bytes_in_join in JoinSwitcher if no join limits 2020-02-18 17:19:13 +03:00
Nikolai Kochetov
5d0d2b25e1 Update MergingSortedTransform 2020-02-18 17:15:50 +03:00
Nikolai Kochetov
41851b62e9 Fix TreeExecutorBlockInputStream 2020-02-18 16:29:40 +03:00
Nikolai Kochetov
49926098d3 Update BlockStreamProfileInfo 2020-02-18 16:16:30 +03:00
chertus
f1673e1344 fix JoinSwitcher logic 2020-02-18 15:41:23 +03:00
Pavel Kovalenko
0040ad3289 Fixed includes. 2020-02-18 15:24:20 +03:00
Nicolae Vartolomei
b612cbf7d8 Fix typo in file name when reporting version file duplicates 2020-02-18 11:44:16 +00:00
Nikolai Kochetov
145cb6e12f Update TreeExecutorBlockInputStream. 2020-02-18 13:39:08 +03:00
Nikolai Kochetov
b6b4a87206 Update TreeExecutorBlockInputStream. 2020-02-18 13:37:57 +03:00
alexey-milovidov
9e4b29fe6c
Merge pull request #9156 from azat/SPLIT_SHARED_LIBRARIES-OFF_robust-build 
Make SPLIT_SHARED_LIBRARIES=OFF more robust
 2020-02-18 12:51:32 +03:00
Pavel Kovalenko
a8cffd55aa Formatting issues. 2020-02-18 12:51:22 +03:00
alexey-milovidov
b688fc5895
Merge pull request #9174 from azat/O_CLOEXEC 
[RFC] Set O_CLOEXEC
 2020-02-18 12:50:19 +03:00
Nikolai Kochetov
9b8fa9f306 Update TreeExecutor. 2020-02-18 12:05:49 +03:00
Nikolai Kochetov
426a8fd6a2 Update TreeExecutor. 2020-02-18 12:03:17 +03:00
Nikolai Kochetov
e6a30feed0 Fix build. 2020-02-18 10:53:16 +03:00
Azat Khuzhin
3bccd81752 Use -undefined,dynamic_lookup over --unresolved-symbols=ignore-all on OSX 
Since OSX does not have later [1]:

    ld: unknown option: --unresolved-symbols=ignore-all
    clang: error: linker command failed with exit code 1 (use -v to see invocation)

  [1]: https://clickhouse-builds.s3.yandex.net/9156/eb89764d9dd631a9227ad9c36ad7d6f3ac8d0a4e/build_log_611498641_1581938330.txt
 2020-02-18 07:09:24 +03:00
Azat Khuzhin
1313ec7d1b Make SPLIT_SHARED_LIBRARIES=OFF more robust 
Refs: #6915
Closes: #9006
Fixes: #9005
 2020-02-18 07:09:03 +03:00
Pavel Kovalenko
33443c4bea Merge branch 'master' into storage-stripe-log-s3 
# Conflicts:
#	dbms/src/Compression/CompressedReadBufferFromFile.h
#	dbms/src/IO/ReadBufferFromFileBase.h
 2020-02-18 00:29:09 +03:00
Azat Khuzhin
aa252e48b8 Set O_CLOEXEC 
Since clickhouse allows to execute user-specified command (i.e.
for dictionary loading), it is better not to expose them.

But there is something left for now:
- 10 -> socket:[14422712]
- 11 -> socket:[14422714]
- 12 -> anon_inode:[eventpoll]
- 13 -> anon_inode:[eventpoll]
- 14 -> anon_inode:[eventpoll]
- 15 -> socket:[14426310]
- 16 -> anon_inode:[eventpoll]
- 3 -> /proc/2739071/fd
- 6 -> socket:[14422708]
- 9 -> socket:[14422710]

And most of these (eventpoll) went from poco, for which O_CLOEXEC cannot
be passed.
 2020-02-18 00:28:11 +03:00
alexey-milovidov
3fcf2d4e78
Merge pull request #9155 from ClickHouse/obfuscator-overgenerate-data 
clickhouse-obfuscator: allow to generate more data than was in source
 2020-02-17 23:51:57 +03:00
Pavel Kovalenko
e849654628 Reworked ReadIndirectBuffer for DiskMemory. 2020-02-17 23:08:35 +03:00
alexey-milovidov
146109fe27
Merge pull request #9161 from abyss7/arcadia 
Reorganize layout of repository (part 1)
 2020-02-17 21:58:20 +03:00
Alexey Milovidov
a1ccd14032 Fixed error with zero bytes in haystack for constant case #9160 2020-02-17 21:53:59 +03:00
Alexey Milovidov
808e27bf30 Added a test #9160 2020-02-17 21:52:10 +03:00
chertus
a9e743d8bd minor JoinSwitcher optimisation 2020-02-17 20:41:38 +03:00
chertus
5717d48333 better includes 2020-02-17 20:21:03 +03:00
alexey-milovidov
35f1a8ed51
Fixed awful translation 2020-02-17 20:12:22 +03:00
chertus
4a658f4325 swtich HashJoin to MergeJoin if JOIN limit exceeded 2020-02-17 20:08:31 +03:00
Nikolai Kochetov
bdaeafffc1 Processors support for StorageLiveView reading. 2020-02-17 19:37:18 +03:00
Nikolai Kochetov
fbfaac6391 Processors support for StorageLiveView reading. 2020-02-17 19:35:23 +03:00
Nikolai Kochetov
34d7873524 Processors support for StorageKafka reading. 2020-02-17 19:08:22 +03:00
Nikolai Kochetov
98b6ad4eff Processors support for StorageXDBC reading. 2020-02-17 18:33:16 +03:00
Nikolai Kochetov
dda0bcb9ba Processors support for StorageXDBC reading. 2020-02-17 18:32:27 +03:00
Nikolai Kochetov
728ece09f1 Processors support for StorageView reading. 2020-02-17 18:27:51 +03:00
Nikolai Kochetov
4cc3eaa9ce Processors support for StorageValues reading. 2020-02-17 18:07:42 +03:00
Nikolai Kochetov
5372942aef Processors support for StorageURL reading. 2020-02-17 18:01:03 +03:00
Pavel Kovalenko
cf474e1f09 Fixed DiskMemory->readFile() test. 2020-02-17 18:00:39 +03:00
Nikolai Kochetov
df76f1fe56 Processors support for StorageTinyLog reading. 2020-02-17 17:45:10 +03:00
Ivan Lezhankin
102dad0ca0 Merge branch 'master' into arcadia 2020-02-17 17:37:10 +03:00
Nikolai Kochetov
9eda64fcf7 Update SelectStreamFactory. 2020-02-17 17:28:44 +03:00
Ivan Lezhankin
39ea079034 More clean-up 2020-02-17 17:27:09 +03:00
Alexey Milovidov
809b409426 Read the code 2020-02-17 15:44:58 +03:00
Nikolai Kochetov
34e32db810 Fix build. 2020-02-17 14:55:32 +03:00
Nikolai Kochetov
bbdac39d2d Fix build. 2020-02-17 14:50:53 +03:00
Nikolai Kochetov
f4d5175a12 Fix build. 2020-02-17 14:26:09 +03:00
Pavel Kovalenko
cceaf69264 Change log_family_disk_memory test number. 2020-02-17 13:51:16 +03:00
Pavel Kovalenko
f3bec50d22 Fixed getPositionInFile() method usages. 2020-02-17 13:49:36 +03:00
Pavel Kovalenko
f9965a7d29 Merge branch 'master' into storage-stripe-log-s3 
# Conflicts:
#	dbms/tests/config/disks.xml
 2020-02-17 13:46:06 +03:00
Nikolai Kochetov
4599fbd798 Added force_tree_shaped_pipeline flag to SelectQueryInfo. 2020-02-17 13:42:14 +03:00
chertus
c2d6167f2a Merge branch 'master' into joins 2020-02-17 13:19:15 +03:00
Nikolai Kochetov
9b2d03f58c Fix StorageMerge. 2020-02-17 12:26:15 +03:00
Alexey Milovidov
d66d1c7930 Added a test for obfuscator 2020-02-17 11:05:48 +03:00
Alexey Milovidov
76153ed8ac clickhouse-obfuscator: allow to generate more data than was in source 2020-02-17 10:52:13 +03:00
Alexey Milovidov
09e18f05ce Fixed error, added a test #9143 2020-02-17 09:54:24 +03:00
Alexey Milovidov
35e7197c8f Merge branch 'master' into bit-test-many-fuzz 2020-02-17 08:43:44 +03:00
Alexey Milovidov
b88238dffc Added 9th reason why parts can appear to be non byte-identical after download 2020-02-17 08:16:48 +03:00
alexey-milovidov
ca00c9c4cd
Merge pull request #9150 from ClickHouse/fix-bug-demangle 
Fix bug in "demangle" function
 2020-02-17 07:22:11 +03:00
alexey-milovidov
e0b6019878
Merge pull request #9014 from amosbird/joingetfix2 
Fix joinGet with nullable return types.
 2020-02-17 06:59:40 +03:00
alexey-milovidov
930cb5c3c3
Merge pull request #9152 from azat/poco-1.7.6-fix 
Drop unused ALL_ADDRESSES const (fixes poco 1.7.6+dfsg1-5+deb9u1)
 2020-02-17 06:58:35 +03:00
Amos Bird
0dee987831
Fix joinGet with nullable return types. 2020-02-17 07:32:32 +08:00
Azat Khuzhin
c2d7922413 Drop unused ALL_ADDRESSES const (fixes poco 1.7.6+dfsg1-5+deb9u1) 
With poco 1.7.6+dfsg1-5+deb9u1:
  5  0x00007f9921e48085 in __cxa_throw ()
  6  0x00007f9918dfca88 in Poco::Net::IPAddress::IPAddress(void const*, unsigned int, unsigned int) () from /usr/lib/libPocoNet.so.46
  7  0x00007f9918dfcf91 in Poco::Net::IPAddress::operator&(Poco::Net::IPAddress const&) const () from /usr/lib/libPocoNet.so.46
  8  0x00007f991737a623 in DB::AllowedClientHosts::IPSubnet::set (this=0x7f991742afa0 <DB::(anonymous namespace)::ALL_ADDRESSES>, prefix_=..., mask_=...) at AllowedClientHosts.h:146
  9  0x00007f991737a2da in DB::AllowedClientHosts::IPSubnet::IPSubnet (this=0x7f991742afa0 <DB::(anonymous namespace)::ALL_ADDRESSES>, prefix_=..., mask_=...) at AllowedClientHosts.h:24
  10 0x00007f991737a0a2 in __static_initialization_and_destruction_0 (__initialize_p=1, __priority=65535) at AllowedClientHosts.cpp:25

Fixes: 2e4174a54c
 2020-02-16 21:24:38 +03:00
Alexey Milovidov
01d4805989 Merge branch 'master' into bit-test-many-fuzz 2020-02-16 15:05:20 +03:00
Alexey Milovidov
405630d38e Added test #8985 2020-02-16 14:58:54 +03:00
Alexey Milovidov
9cd79c8a38 Fixed bug in "demangle" #8985 2020-02-16 14:55:45 +03:00
alexey-milovidov
4db0eac979
Merge pull request #9149 from ClickHouse/fix-bad-join-test 
Fixed non-deterministic test
 2020-02-16 13:53:11 +03:00
Alexey Milovidov
2e8d42a188 Additions to prev. revision 2020-02-16 13:44:24 +03:00
alexey-milovidov
a3eac2688b
Merge pull request #9144 from ClickHouse/describe-query-profiler-when-unavailable 
Describe reasons when query profiler cannot work
 2020-02-16 11:57:59 +03:00
Alexey Milovidov
ecbc3c5f33 Fixed non-deterministic test 2020-02-16 11:54:41 +03:00
alexey-milovidov
355ff00c2e
Revert "Build fixes" 2020-02-16 11:48:01 +03:00
Ivan Lezhankin
4cedd4619d Code clean-up 2020-02-16 11:04:03 +03:00
Alexey Milovidov
3772ffdc9d Describe reasons when query profiler cannot work 2020-02-16 09:51:52 +03:00
Alexey Milovidov
63b7d6e5ac Describe reasons when query profiler cannot work 2020-02-16 09:49:24 +03:00
Alexey Milovidov
724be6d08f Fixed fuzz test and incorrect behaviour of bitTestAll/Any functions 2020-02-16 09:46:29 +03:00
alexey-milovidov
41c883ace3
Merge pull request #8911 from millb/secure_password 
Changed format for path in replicas
 2020-02-16 07:17:12 +03:00
alexey-milovidov
4ebb240be6
Update Cluster.h 2020-02-16 07:13:54 +03:00
alexey-milovidov
5ebabe519f
Update Cluster.cpp 2020-02-16 07:12:48 +03:00
alexey-milovidov
480881563a
Slightly more readable. 2020-02-16 07:11:19 +03:00
alexey-milovidov
6f51f089ec
Merge pull request #9138 from ClickHouse/system-replicas-add-zookeeper-exception-column 
Add zookeeper_exception column to system.replicas table.
 2020-02-16 06:14:22 +03:00
alexey-milovidov
76f09ec883
Merge pull request #9052 from oandrew/reinterpret-fixedstring-bugfix 
Use correct implementation for reinterpretAsFixedString
 2020-02-16 06:11:13 +03:00
Andrew Onyshchuk
55b9af60ca Add test for reinterpretAsFixedString 2020-02-15 17:49:32 -06:00
Alexey Milovidov
4ae404f794 Implement #9137 2020-02-15 03:13:00 +03:00
Alexey Milovidov
07479236d7 Implement #9137 2020-02-15 03:11:09 +03:00
alexey-milovidov
e9af153819
Merge pull request #9126 from Melancholic/change_http_status 
Fixed #5104. Return 503 status in /replicas_status if not ok
 2020-02-15 02:59:18 +03:00
alexey-milovidov
7f581fb555
Merge pull request #9135 from den-crane/test-for-6143 
tests for #6143 and #2314
 2020-02-15 02:57:20 +03:00
alexey-milovidov
38c4f3ed84
Merge pull request #9131 from ClickHouse/better_temporary_live_view_syntax 
Better CREATE syntax for temporary LIVE VIEW
 2020-02-15 02:55:37 +03:00
alexey-milovidov
ab702acf12
Merge pull request #9105 from ClickHouse/aku/flap-faster 
Make some performance tests faster.
 2020-02-15 02:54:16 +03:00
alexey-milovidov
a264f4a4dc
Merge pull request #9061 from ClickHouse/aku/flappy-perf 
Less flappy performance test queries
 2020-02-15 02:53:10 +03:00
alexey-milovidov
f836987f31
Merge pull request #9041 from proller/fix27 
Build fixes
 2020-02-15 02:51:18 +03:00
alexey-milovidov
71c6430f10
Merge pull request #9129 from Jokser/disks-section-for-functional-tests 
Added disks section for stateless functional testing.
 2020-02-15 02:48:19 +03:00
alexey-milovidov
ec1191e4e8
Update disks.xml 2020-02-15 02:47:24 +03:00
alexey-milovidov
4d0d32da23
Merge pull request #9091 from PerformanceVision/bit_on_bitset 
Implement bit operations for FixedString datatype for doing bits operation on a bitset
 2020-02-15 02:43:29 +03:00
alexey-milovidov
db1c67e3e3
Merge pull request #9100 from ClickHouse/issue-9094 
Prevent abort on shutdown if the fs is readonly
 2020-02-15 02:38:37 +03:00
Denis Zhuravlev
bef505a804 Merge branch 'test-for-6143' of github.com:den-crane/ClickHouse into test-for-6143 2020-02-14 16:43:41 -04:00
Denis Zhuravlev
cce9645848 test for #2314 2020-02-14 16:43:28 -04:00
Denis Zhuravlev
dada5cf6ca
Update 01080_engine_merge_prewhere_tupleelement_error.sql 
optimize_move_to_prewhere=0
 2020-02-14 16:17:29 -04:00
Denis Zhuravlev
eec35ce32d test for #6143 2020-02-14 16:11:38 -04:00
Alexander Kuzmenkov
4c4448c04b
Update ngram_distance.xml 2020-02-14 22:49:54 +03:00
Alexander Kuzmenkov
e3abc3b60d
Update general_purpose_hashes_on_UUID.xml 2020-02-14 22:46:27 +03:00
Alexander Kuzmenkov
db0f2a5dba
Update codecs_int_insert.xml 2020-02-14 22:44:59 +03:00
Alexander Kuzmenkov
51815044c5
Merge pull request #8943 from ClickHouse/aku/flush-perf 
[wip] Improve flush performance in SystemLog
 2020-02-14 22:41:44 +03:00
proller
cf39e9d64a Merge remote-tracking branch 'upstream/master' into fix27 2020-02-14 21:28:09 +03:00
Alexander Tokmakov
6889951396 better syntax for temporary LIVE VIEW 2020-02-14 21:20:20 +03:00
Nikolai Kochetov
1685c4d689 Fix build. 2020-02-14 20:50:27 +03:00
Nikolai Kochetov
52a63275ea Merge with master. 2020-02-14 20:47:39 +03:00
Nikolai Kochetov
97f0e1ffdc Fix SelectStreamFactory. 2020-02-14 20:03:23 +03:00
Pavel Kovalenko
7c585291b5 Added disks section for stateless functional testing. 2020-02-14 18:37:51 +03:00
Anton Popov
1162c22063
Merge pull request #9106 from CurtizJ/fix-range-reader 
Fix segfault in MergeTreeRangeReader
 2020-02-14 17:59:43 +03:00
Pavel Kovalenko
06e203d004 StorageStripeLog S3 support. 2020-02-14 17:28:33 +03:00
nagorny
15d3176d40 Ticket #5104. Return 503 status from /replicas_status if not ok 2020-02-14 17:20:27 +03:00
Nikolai Kochetov
ce6bcb77a2 Fix TreeExecutor. 2020-02-14 17:05:31 +03:00
Nikolai Kochetov
da6d43ea8a Fix TreeExecutor. 2020-02-14 17:00:39 +03:00
Alexander Kuzmenkov
6b09956277 review fixes 2020-02-14 16:09:51 +03:00
Alexander Kuzmenkov
191759ba17
Update set_hits.xml 2020-02-14 14:15:26 +03:00
Alexander Kuzmenkov
76e2065162
Update codecs_int_insert.xml 2020-02-14 14:12:44 +03:00
Alexander Kuzmenkov
e0b7755fa7
Update general_purpose_hashes_on_UUID.xml 2020-02-14 14:03:44 +03:00
Nikolai Kochetov
96b5ef8459 Processors support for StorageStripeLog reading. 2020-02-14 13:57:09 +03:00