thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-30 13:40:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
57,550 Commits 8,956 Branches 1,767 Tags 1.8 GiB
7c04f15c80
Commit Graph

469 Commits

Author SHA1 Message Date
Nikolai Kochetov
4905201985 Merge branch 'master' into async-read-from-socket 2020-12-15 21:04:47 +03:00
nikitamikhaylov
4ff1be6e25 better 2020-12-15 00:56:47 +03:00
nikitamikhaylov
5b7af8aa9c add extremes and totals 2020-12-15 00:56:47 +03:00
Nikita Mikhaylov
da43504654 better 2020-12-15 00:56:47 +03:00
Nikita Mikhaylov
9922324787 it works 2020-12-15 00:56:47 +03:00
Nikita Mikhaylov
9f127a46c7 first try 2020-12-15 00:56:47 +03:00
Nikita Mikhaylov
0a508c7b8a save 2020-12-15 00:56:46 +03:00
alexey-milovidov
91be7a6f27
Merge pull request #16809 from kitaisreal/read-float-8digits-unroll-performance-improvement 
ReadFloat 8digits unroll performance improvement
 2020-12-14 23:03:21 +03:00
alexey-milovidov
363ff79cca
Merge pull request #17934 from Jokser/s3-adaptive-single-part-upload 
Adaptive choose of single/multi part upload in WriteBufferFromS3
 2020-12-14 23:00:43 +03:00
Nikolai Kochetov
8de5cd5bc7 Merge branch 'master' into async-read-from-socket 2020-12-14 17:45:38 +03:00
Nikolai Kochetov
e295dfe6e3 Use ucontext for asan 2020-12-14 17:42:08 +03:00
Nikolai Kochetov
116bed2cfd Fixing build. 2020-12-14 17:42:00 +03:00
alexey-milovidov
60efab623d
Update S3Common.cpp 2020-12-14 13:53:40 +03:00
Vladimir Chebotarev
418c974eaf
Fixed std::out_of_range: basic_string in S3 URL parsing. 2020-12-14 11:17:29 +03:00
Pavel Kovalenko
346c241c20 Merge remote-tracking branch 'origin/master' into s3-adaptive-single-part-upload 
# Conflicts:
#	src/Disks/S3/DiskS3.cpp
 2020-12-14 11:00:30 +03:00
alexey-milovidov
5da9315ceb
Update readFloatText.h 2020-12-14 05:22:17 +03:00
alexey-milovidov
66b2424e33
Update readFloatText.h 2020-12-14 05:20:00 +03:00
alexey-milovidov
04e222f6f3
Merge pull request #17986 from azat/fwd-decl 
More forward declaration for generic headers
 2020-12-13 01:12:05 +03:00
alexey-milovidov
2eabd41749
Merge pull request #17659 from nautaa/master 
add function to escape charaters for XML
 2020-12-12 23:43:41 +03:00
Azat Khuzhin
5b3ab48861 More forward declaration for generic headers 
The following headers are pretty generic, so use forward declaration as
much as possible:
- Context.h
- Settings.h
- ConnectionTimeouts.h
(Also this shows that some missing some includes -- this has been fixed)

And split ConnectionTimeouts.h into ConnectionTimeoutsContext.h (since
module part cannot be added for it, due to recursive build dependencies
that will be introduced)

Also remove Settings from the RemoteBlockInputStream/RemoteQueryExecutor
and just pass the context, since settings was passed only in speicifc
places, that can allow making a copy of Context (i.e. Copier).

Approx results (How much units will be recompiled after changing file X?):

- ConnectionTimeouts.h
  - mainline: 100

- Context.h:
  - mainline: ~800
  - patched:  415

- Settings.h:
  - mainline: 900-1K
  - patched:  440 (most of them because of the Context.h)
 2020-12-12 17:43:10 +03:00
Pavel Kovalenko
59a5e63417 Merge remote-tracking branch 'origin/master' into s3-adaptive-single-part-upload 
# Conflicts:
#	src/Disks/S3/DiskS3.cpp
#	src/Disks/S3/DiskS3.h
#	src/Disks/S3/registerDiskS3.cpp
#	src/IO/WriteBufferFromS3.cpp
#	src/IO/WriteBufferFromS3.h
 2020-12-11 18:28:41 +03:00
Kruglov Pavel
6300cd285f
Merge pull request #17909 from Jokser/disk-s3-send-metadata 
Ability to set metadata when put S3 object
 2020-12-11 17:01:14 +03:00
nauta
00dc104025 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse 2020-12-11 16:15:40 +08:00
alexey-milovidov
f7d1441858
Update WriteHelpers.h 2020-12-11 00:09:52 +03:00
nikitamikhaylov
17310c6c50 fix-arcadia 2020-12-10 21:08:16 +03:00
Kruglov Pavel
9a785dbbf5
Merge branch 'master' into disk-s3-send-metadata 2020-12-10 20:17:41 +03:00
nikitamikhaylov
955033d6a1 done 2020-12-10 16:18:37 +03:00
Vladimir Chebotarev
39d867e56d
Added proper authentication for S3 client (#16856) 2020-12-10 12:19:42 +03:00
Nikolai Kochetov
0e44a22f43 Fixing build. 2020-12-09 19:17:59 +03:00
Nikolai Kochetov
32b38f389e Merge branch 'master' into async-read-from-socket 2020-12-09 17:15:36 +03:00
Nikolai Kochetov
156f44808f Fixing crash. 2020-12-09 17:11:45 +03:00
Pavel Kovalenko
db7a87089b Adaptive choose of single/multi part upload in WriteBufferFromS3. 2020-12-09 17:09:04 +03:00
alexey-milovidov
e127636a4b
Merge pull request #16787 from kitaisreal/fast-float-integration 
FastFloat library integration
 2020-12-08 21:34:34 +03:00
Pavel Kovalenko
dfbb31174e Ability to set metadata when put S3 object 2020-12-08 21:31:57 +03:00
alexey-milovidov
ab10cb4bf9
Merge pull request #17707 from ClickHouse/quota-by-x-forwarded-for 
Allow quotas to be keyed by proxy-forwarded IP address; add support for PROXY protocol
 2020-12-08 14:48:05 +03:00
Nikolai Kochetov
7d77a7ba24
Merge pull request #16952 from Enmk/DateTime64_fixes_comparison 
Fixed comparison of DateTime64 with different scales
 2020-12-08 12:40:41 +03:00
Maksim Kita
a9a6517291 Fixed style 2020-12-07 19:26:38 +03:00
Alexey Milovidov
1ed329017b Merge branch 'master' into quota-by-x-forwarded-for 2020-12-07 18:22:19 +03:00
Maksim Kita
b0afa8488d Updated parse float precise implementation 2020-12-07 17:23:02 +03:00
Maksim Kita
c3864d2fbf Updated contrib CMakeLists 2020-12-07 14:08:19 +03:00
Maksim Kita
b6bfb1cf20 Use fast_float by default 2020-12-06 23:37:36 +03:00
Maksim Kita
5f410718ca Fix marker check 2020-12-06 23:37:35 +03:00
Maksim Kita
ccbfd52315 Fixed compile issues 2020-12-06 23:37:35 +03:00
Maksim Kita
095137b9f7 FastFloat conditional replace precise parsing 2020-12-06 23:37:35 +03:00
Maksim Kita
87c50602bc Fast float updated implementation 2020-12-06 23:37:35 +03:00
Maksim Kita
7d97f23db4 Fixed point 2020-12-06 23:37:35 +03:00
Maksim Kita
80d66b8868 FastFloat library integration 2020-12-06 23:37:35 +03:00
alexey-milovidov
878864602c
Merge pull request #17831 from kitaisreal/dragonbox-integration 
DragonBox integration
 2020-12-06 22:58:56 +03:00
alexey-milovidov
614420feb9
Merge pull request #17794 from excitoon-favorites/s3testiostream 
Attempt to use IOStream in AWS SDK
 2020-12-06 16:42:12 +03:00
nauta
8e615a1d8d Merge remote-tracking branch 'upstream/master' 2020-12-06 20:48:47 +08:00
Maksim Kita
977da3d052 Removed ryu 2020-12-06 15:39:39 +03:00
Maksim Kita
64549702a2 DragonBox integration 2020-12-06 00:32:03 +03:00
Vladimir Chebotarev
a5e3d89649 Attempt to use IOStream in AWS SDK. 2020-12-04 13:37:08 +03:00
Ivan
6a48d25b74
Fix arcadian build (#17781) 2020-12-04 02:32:17 +03:00
alexey-milovidov
9d7667dada
Update ReadHelpers.h 2020-12-03 16:24:32 +03:00
Nikolai Kochetov
082a496364 Add async read to RemoteQueryExecutor 2020-12-03 15:21:10 +03:00
Alexey Milovidov
3e2447391b Support for PROXY protocol 2020-12-03 00:05:51 +03:00
alexey-milovidov
85f4045160
Merge pull request #17144 from fibersel/issue-16791 
introduce zstd compression (for data import/export)
 2020-12-02 22:41:07 +03:00
Nikolai Kochetov
e3946bc2b5 Add async read to RemoteQueryExecutor. 2020-12-02 20:02:14 +03:00
nautaa
4cc56c2501 rename function name 2020-12-02 17:00:27 +08:00
nautaa
eb0c442763 add function to escape charaters for HTML 2020-12-01 16:32:09 +08:00
Vasily Nemkov
87945fb68b Merge branch 'master' into HEAD 2020-11-30 23:25:57 +03:00
tavplubix
db3918d88d
Merge pull request #16861 from Jokser/disk-s3-proxy-tunnel-mode 
Support HTTP proxy and HTTPS S3 endpoint configuration
 2020-11-30 16:05:12 +03:00
a.palagashvili
1e71725143 fix typo 2020-11-29 16:02:04 +03:00
a.palagashvili
9c5640f443 merged 2020-11-29 15:19:19 +03:00
a.palagashvili
7a20fad305 added errors checking, removed redundant variables 2020-11-29 15:17:19 +03:00
a.palagashvili
502355922d added errors checking, removed redundant variables 2020-11-29 15:14:42 +03:00
a.palagashvili
7b886252ac added errors checking, removed redundant variables 2020-11-29 15:08:28 +03:00
Alexander Kuzmenkov
edce1e636e
Merge pull request #16535 from ClickHouse/aku/opentelemetry 
OpenTelemetry improvements
 2020-11-25 14:10:17 +03:00
Vitaly Baranov
08b3707842
Merge pull request #15111 from vitlibar/grpc-protocol 
Implement GRPC protocol.
 2020-11-25 09:00:32 +03:00
Alexander Kuzmenkov
1d7dcef4a0 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-24 21:45:10 +03:00
Alexander Kuzmenkov
8de415861f
Merge pull request #17206 from ClickHouse/aku/noescape 
Remove escaping from toString(std::string)
 2020-11-24 21:23:39 +03:00
Vitaly Baranov
93459d854b Fix WriteBufferFromVector: restart() now resize empty container to initial_size 
because WriteBufferFromVector can't operate with empty container.
 2020-11-24 17:53:34 +03:00
alesapin
45f09fe293
Merge pull request #17220 from ianton-ru/s3_max_redirects 
S3 max redirects
 2020-11-24 12:13:10 +03:00
Alexander Kuzmenkov
951a59eff7 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-23 21:00:22 +03:00
Anton Ivashkin
aa208a9d9f Use only 's3_max_redirect' in params instead of all settings 2020-11-23 14:02:17 +03:00
Vladimir Chebotarev
b3e2ebbaa5 Used global region for accessing S3 if can't determine exactly. 2020-11-23 08:19:38 +03:00
alexey-milovidov
203db68250
Update ZstdDeflatingWriteBuffer.cpp 2020-11-23 07:14:41 +03:00
alexey-milovidov
945aa009ad
Update ZstdDeflatingWriteBuffer.h 2020-11-23 07:13:02 +03:00
alexey-milovidov
d47cf8c919
Update ZstdInflatingReadBuffer.cpp 2020-11-23 07:11:52 +03:00
Alexey Milovidov
fbbf439338 Merge branch 'master' into Enmk-DateTime64_fixes_comparison 2020-11-23 05:46:17 +03:00
tavplubix
3e335c1e95
Merge pull request #17091 from zhang2014/fix/binlog_checksum 
Fix MaterializeMySQL SYNC failure when modify binlog_checksum
 2020-11-20 13:25:14 +03:00
Anton Ivashkin
a7d4f4be65 Add 's3_max_redirects' test 2020-11-20 11:18:44 +03:00
Alexander Kuzmenkov
7fa779c2ef Remove escaping from toString(std::string) 
This is just confusing, I'd expect it to be an identity. It looks
especially weird when you do something like `toString(Field("don't escape
me"))`. Let's see which tests are going to fail.
 2020-11-19 18:26:44 +03:00
zhang2014
bed93ef713 Try fix review comment 2020-11-19 12:02:43 +08:00
Alexander Kuzmenkov
f2b3f5f8b6 Allow formatting named tuples as JSON objects 2020-11-18 13:38:30 +03:00
a.palagashvili
22f147ab0f added newline, fixed initialization in constructor 2020-11-17 23:14:22 +03:00
Alexander Kuzmenkov
b16c5a1748 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-17 22:54:54 +03:00
a.palagashvili
b737a5ea9f added newlines, fixed formatting 2020-11-17 21:36:18 +03:00
a.palagashvili
6f5390cc70 introduce zstd compression 2020-11-17 19:02:10 +03:00
zhang2014
cc0134f361 Try fix asan build 2020-11-17 23:29:02 +08:00
Alexey Milovidov
24f4fa6edf Follow Arcadia ya.make rules 2020-11-17 00:16:50 +03:00
Alexey Milovidov
3df04ce0c2 Follow Arcadia ya.make rules 2020-11-16 21:24:58 +03:00
zhang2014
6ef93ac73c Try fix MaterializeMySQL SYNC with modify binlog_checksum 2020-11-16 21:46:36 +08:00
Maksim Kita
437bbef5b9 Fix marker check 2020-11-15 13:07:23 +03:00
Maksim Kita
1b9c20a5df ReadFloat 8digits unroll performance improvement 2020-11-15 13:07:23 +03:00
Anton Ivashkin
15b5d3a55a Merge master 2020-11-13 19:32:35 +03:00
Anton Ivashkin
026f7e0a27 Add 's3_max_redirects' setting 2020-11-13 19:31:51 +03:00
Vasily Nemkov
eb9604ecd0 Fixed comparison of DateTime4 with different scales 
Made DateTime64 a stand-alone type rather than typedef to allow function resolution/deduction based on type.
Added tests.
 2020-11-12 23:32:16 +03:00
Nikolai Kochetov
75e78026de Fty to fix ci 2020-11-12 13:03:10 +03:00
Nikolai Kochetov
85a4849756 Fty to fix ci 2020-11-12 12:21:33 +03:00
alexey-milovidov
34b2a460ba
Merge pull request #16578 from fibersel/issue-8828 
add compression method for files: Xz
 2020-11-12 02:58:52 +03:00
a.palagashvili
fe5800a27e remove commented code 2020-11-12 02:12:51 +03:00
tavplubix
058aa8f85e
Merge pull request #16824 from ClickHouse/replace_stringstreams_with_buffers 
Replace std::*stringstreams with DB::*Buffers
 2020-11-12 01:11:44 +03:00
Alexander Tokmakov
dbac7860b1 review suggestions 2020-11-11 16:27:54 +03:00
a.palagashvili
1b06fd9373 regenerated ya.make 2020-11-11 15:57:35 +03:00
Pavel Kovalenko
e311759c5d
Abort multipart upload if no data was written to WriteBufferFromS3. (#16840) 2020-11-11 15:15:16 +03:00
Pavel Kovalenko
adfe966c46 Support HTTP proxy and HTTPS S3 endpoint configuration. 2020-11-11 12:30:32 +03:00
a.palagashvili
124ef2f5fa added and successfully passed tests for content encoding and file() function, formatted code 2020-11-11 04:50:56 +03:00
Alexander Tokmakov
b94cc5c4e5 remove more stringstreams 2020-11-10 21:22:26 +03:00
Alexander Tokmakov
55631e442b fix bug in WriteBufferFromVector 2020-11-10 14:43:22 +03:00
Alexander Kuzmenkov
55c7051330 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-10 08:50:54 +03:00
a.palagashvili
f999ea2a6f renamed files, added new library, changed error codes, added tests for file() function 2020-11-10 01:52:22 +03:00
Alexander Tokmakov
5cdfcfb307 remove other stringstreams 2020-11-09 22:12:44 +03:00
a.palagashvili
6286775031 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into issue-8828 2020-11-09 19:53:20 +03:00
Alexander Tokmakov
62ff00ee8b use WriteBuffer in formatAST(...) 2020-11-09 19:05:40 +03:00
Alexander Tokmakov
a06be511df pcg serialization 2020-11-09 16:07:38 +03:00
Maksim Kita
240bbd2cd7 Removed fast path for parsing DateTime in Date format 2020-11-09 11:29:08 +03:00
Maksim Kita
02da9af32d DateTime comparison with date string literal 2020-11-09 11:29:08 +03:00
Alexander Kuzmenkov
2fe9c76728 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-09 09:37:50 +03:00
Alexey Milovidov
dba57529f8 Merge branch 'master' of github.com:yandex/ClickHouse into fix-stringstream 2020-11-07 22:03:38 +03:00
a.palagashvili
268f289bd1 resolved conflict 2020-11-07 16:36:38 +03:00
a.palagashvili
73e5d283aa regenerated ya.make 2020-11-07 16:24:21 +03:00
Alexey Milovidov
fd84d16387 Fix "server failed to start" error 2020-11-07 03:14:53 +03:00
Alexey Milovidov
7b72894363 Simplified code 2020-11-06 23:23:08 +03:00
Alexey Milovidov
c35e7ec74e Merge branch 'master' into https-sni 2020-11-06 21:44:26 +03:00
Alexey Milovidov
b56486510f Improve Arcadia 2020-11-05 12:55:01 +03:00
a.palagashvili
87cc3546ca fix codestyle 2020-11-04 19:39:26 +03:00
a.palagashvili
53a064b6e3 added eof initializing in constuctor 2020-11-04 15:45:37 +03:00
a.palagashvili
986d13df3a replaced null with nullptr 2020-11-04 03:35:16 +03:00
a.palagashvili
f9cebbfa81 added newline for files 2020-11-04 02:47:39 +03:00
a.palagashvili
ba6fa5d828 fixed whitespaces, added hidden submodule file 2020-11-02 23:04:49 +03:00
a.palagashvili
2ad01c59da fixed codestyle, added record to changelog 2020-11-02 16:17:25 +03:00
a.palagashvili
805bfd286c resolved git modules 2020-11-02 15:16:49 +03:00
Alexey Milovidov
8a68ee2547 Whitespaces 2020-11-02 13:45:48 +03:00
a.palagashvili
495cd47fd8 fixed compressor testing, added base logic for compressor and decompressor, tests passing 2020-11-02 02:52:34 +03:00
a.palagashvili
be2b002ff4 fixed cmake for building, added test for compression method, added basic code for encoding 2020-11-01 21:40:05 +03:00
a.palagashvili
731e274cd0 changed moment of stream object initialization 2020-11-01 03:14:40 +03:00
a.palagashvili
c1abf5d13c *added adapters' boilerplate for Lzma buffers, *added submodule to gitmodules, *added cmake for xz 2020-11-01 02:56:41 +03:00
alesapin
ae53092536 Merge branch 'master' into system_fetches_table 2020-10-31 18:45:17 +03:00
alexey-milovidov
15a342e5e1
Merge pull request #16541 from ucasFL/parse-null 
fix parseDateTimeBestEffortOrNull with empty string
 2020-10-31 06:38:51 +03:00
alexey-milovidov
83220b0956
Update parseDateTimeBestEffort.cpp 2020-10-30 16:00:49 +03:00
alesapin
be183027b3
Merge pull request #16516 from zlobober/remove_g0 
Remove -g0 form Arcadia build settings.
 2020-10-30 13:58:08 +03:00
Alexander Kuzmenkov
15317fcbd1 Merge remote-tracking branch 'origin/master' into HEAD 2020-10-30 13:34:20 +03:00
alesapin
b34960bffa Merge branch 'master' into system_fetches_table 2020-10-30 11:33:37 +03:00
feng lv
f428675b6e fix parseDateTimeBestEffortOrNull with empty string 2020-10-30 05:42:10 +00:00
Alexander Kuzmenkov
18fbb3dc23 some drafts 2020-10-30 00:29:10 +03:00
Pavel Kruglov
dbfef325e6 Rename NullSink to NullOutput 2020-10-29 20:22:48 +03:00
Maxim Akhmedov
3627fabfb9 Remove -g0 form Arcadia build settings. 2020-10-29 17:37:23 +03:00
alesapin
1c9e24b5e2 Merge branch 'master' into system_fetches_table 2020-10-28 10:20:04 +03:00