thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-18 05:32:52 +00:00
Code Issues Packages Projects Releases Wiki Activity
57,550 Commits 9,136 Branches 1,774 Tags 2 GiB
7c04f15c80
Commit Graph

469 Commits

Author SHA1 Message Date
Alexander Kuzmenkov
d22c04568d
Merge pull request #13405 from excitoon-favorites/s3keepalive 
Connection pools for S3
 2021-01-18 12:52:37 +03:00
alexey-milovidov
141b5e23b2
Merge pull request #19136 from amosbird/removeuseless 
Remove useless code
 2021-01-16 11:04:55 +03:00
Amos Bird
8b079674a9
Remove useless code 2021-01-16 00:37:41 +08:00
tavplubix
fb6d1dc18e
Merge pull request #18979 from ClickHouse/fix_18690 
Remove unread data limit from PeekableReadBuffer
 2021-01-15 13:43:50 +03:00
alexey-milovidov
2760006415
Update gtest_peekable_read_buffer.cpp 2021-01-14 22:29:34 +03:00
Alexander Tokmakov
547c7af1b1 fix checkpoint in PeekableReadBuffer over ConcatReadBuffer 2021-01-14 17:38:59 +03:00
Alexander Tokmakov
f9ee3f8178 update test 2021-01-14 14:09:13 +03:00
alesapin
2683bbc0f7 Disable lint for test 2021-01-13 18:35:35 +03:00
Alexander Tokmakov
6c4be506fd add test 2021-01-13 16:43:42 +03:00
alesapin
c84a8c4b16 Fix manipulators for common string types 2021-01-13 15:47:34 +03:00
Alexander Tokmakov
111f4d49e3 remove unread data limit from PeekableReadBuffer 2021-01-12 21:55:12 +03:00
Alexey Milovidov
c38dca155c Fix clang-tidy 2021-01-10 05:51:54 +03:00
Alexey Milovidov
6eb5a5f4d9 Remove useless code 2021-01-10 03:28:59 +03:00
Azat Khuzhin
53268d9f05 Fix fsync_after_insert by not closing fd from finalize() 
But this may cause troubles, another option will be to split finalize()
into finalize(bool sync) and finalizeImpl()

This was introduced in #8356
 2021-01-07 19:30:10 +03:00
Vladimir Chebotarev
ad6fe2a8b1 Build fix. 2021-01-05 13:34:55 +03:00
Vladimir Chebotarev
59fb76e8bc Fix. 2021-01-05 13:34:55 +03:00
Vladimir Chebotarev
5cbc25c647 Added global setting s3_max_connections. 2021-01-05 13:34:55 +03:00
Alexey Milovidov
12a0ef907e Slightly better 2021-01-04 21:07:52 +03:00
Alexey Milovidov
d88d3de0d1 Fix UBSan report: applying non-zero offset to nullptr 2021-01-04 02:31:47 +03:00
Nikita Mikhailov
ffd73082ba fix memory and add comment 2020-12-30 01:34:26 +03:00
Nikita Mikhailov
c3288c3fbf Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel-parsing-input-format 2020-12-28 15:09:37 +03:00
alexey-milovidov
230f9b6ad4
Merge pull request #18449 from vladimir-golovchenko/fix-AM-abbreviation-handling-for-parseDateTimeBestEffort 
Bug fix '#18402 parseDateTimeBestEffort should not ignore AM abbreviation for 12th hour'
 2020-12-25 22:32:43 +03:00
Yatsishin Ilya
ce1e2b18a3 Fix codespell warnings. Split style checks. Update style checks docker 2020-12-24 13:17:52 +03:00
vladimir golovchenko
ed4fe206aa Fixed the parseDateTimeBestEffort*-functions to correctly handle '12 am' time. 2020-12-23 18:10:00 -08:00
Nikita Mikhaylov
c005dcdd26
Merge pull request #17641 from nikitamikhaylov/parallel_row_numbers 
Added an offset to exception message for parallel parsing
 2020-12-23 17:24:35 +03:00
Nikolai Kochetov
af7f5c9518
Merge pull request #17868 from ClickHouse/async-read-from-socket 
Async read from socket
 2020-12-23 12:20:42 +03:00
Nikita Mikhailov
dcfbe782c6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel-parsing-input-format 2020-12-23 05:20:22 +03:00
Nikita Mikhailov
138b74aa3b better 2020-12-23 01:04:02 +03:00
nikitamikhaylov
c60c161168 add ParsingException 2020-12-23 01:02:01 +03:00
Denis Glazachev
0c39539c76 Apply path workaround on actual uri_ argument 
Print out actual uri_ argument being used
 2020-12-21 03:29:11 +04:00
Nikolai Kochetov
01c8d5dccc Use replace fiber to callback in ReadBufferFromPocoSocket 2020-12-18 17:24:44 +03:00
Nikita Mikhailov
6a55e018e4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel-parsing-input-format 2020-12-18 02:25:32 +03:00
Nikita Mikhaylov
aa7793e38f
Merge pull request #18084 from nikitamikhaylov/fix-arcadia-third 
Try to fix Arcadia
 2020-12-18 01:54:42 +03:00
alesapin
799997db35
Merge pull request #16621 from arenadata/ADQM-148 
HDFS configuration and Kerberos Authenticaiton
 2020-12-17 23:16:58 +03:00
nikitamikhaylov
d198f03301 suppress warnings 2020-12-17 18:46:26 +03:00
nikitamikhaylov
d70f58a98f remove ryu 2020-12-17 00:52:04 +03:00
Maksim Kita
685099af7f Move getPageSize in common 2020-12-17 00:23:41 +03:00
nikitamikhaylov
50c29d9ed0 better 2020-12-16 18:34:29 +03:00
nikitamikhaylov
18d52dbc63 better 2020-12-16 14:55:33 +03:00
nikitamikhaylov
20aaf48e38 pragmas 2020-12-16 14:55:33 +03:00
nikitamikhaylov
5c4e1d1db5 better 2020-12-16 14:55:33 +03:00
nikitamikhaylov
3288f1fd0c ya make 2020-12-16 14:55:33 +03:00
nikitamikhaylov
c3a6499f6d fix ya.make 2020-12-16 14:55:33 +03:00
Ilya Golshtein
7e97814859 cleanup, fixes, new submodules, ShellCommand, WriteBufferFromString 2020-12-16 14:48:33 +03:00
Ilya Golshtein
d1d657335b USE_INTERNAL_HDFS3_LIBRARY + bash lint 2020-12-16 14:48:33 +03:00
Ilya Golshtein
d9166a0645 HADOOP_SECURE_DN_USER way, kinit thread, docker capabilities 2020-12-16 14:48:33 +03:00
Ilya Golshtein
185ac744b1 kerberized hdfs compiled 2020-12-16 14:48:33 +03:00
Maksim Kita
7d23451e81 Replaced usages of 4096 constant with getPageSize 2020-12-16 13:46:28 +03:00
Maksim Kita
dbb2fbcdd5 Unified usages of getPageSize 
1. Introduced getPageSize function.
2. Replaced usages of getpagesize with getPageSize function.
3. Replaced usages of sysconf(_SG_PAGESIZE) with getPageSize function.
 2020-12-16 13:42:23 +03:00
Maksim Kita
058fbd5222 MMapReadBufferFromFileDescriptor use getpagesize 2020-12-16 13:42:23 +03:00
Nikolai Kochetov
4905201985 Merge branch 'master' into async-read-from-socket 2020-12-15 21:04:47 +03:00
nikitamikhaylov
4ff1be6e25 better 2020-12-15 00:56:47 +03:00
nikitamikhaylov
5b7af8aa9c add extremes and totals 2020-12-15 00:56:47 +03:00
Nikita Mikhaylov
da43504654 better 2020-12-15 00:56:47 +03:00
Nikita Mikhaylov
9922324787 it works 2020-12-15 00:56:47 +03:00
Nikita Mikhaylov
9f127a46c7 first try 2020-12-15 00:56:47 +03:00
Nikita Mikhaylov
0a508c7b8a save 2020-12-15 00:56:46 +03:00
alexey-milovidov
91be7a6f27
Merge pull request #16809 from kitaisreal/read-float-8digits-unroll-performance-improvement 
ReadFloat 8digits unroll performance improvement
 2020-12-14 23:03:21 +03:00
alexey-milovidov
363ff79cca
Merge pull request #17934 from Jokser/s3-adaptive-single-part-upload 
Adaptive choose of single/multi part upload in WriteBufferFromS3
 2020-12-14 23:00:43 +03:00
Nikolai Kochetov
8de5cd5bc7 Merge branch 'master' into async-read-from-socket 2020-12-14 17:45:38 +03:00
Nikolai Kochetov
e295dfe6e3 Use ucontext for asan 2020-12-14 17:42:08 +03:00
Nikolai Kochetov
116bed2cfd Fixing build. 2020-12-14 17:42:00 +03:00
alexey-milovidov
60efab623d
Update S3Common.cpp 2020-12-14 13:53:40 +03:00
Vladimir Chebotarev
418c974eaf
Fixed std::out_of_range: basic_string in S3 URL parsing. 2020-12-14 11:17:29 +03:00
Pavel Kovalenko
346c241c20 Merge remote-tracking branch 'origin/master' into s3-adaptive-single-part-upload 
# Conflicts:
#	src/Disks/S3/DiskS3.cpp
 2020-12-14 11:00:30 +03:00
alexey-milovidov
5da9315ceb
Update readFloatText.h 2020-12-14 05:22:17 +03:00
alexey-milovidov
66b2424e33
Update readFloatText.h 2020-12-14 05:20:00 +03:00
alexey-milovidov
04e222f6f3
Merge pull request #17986 from azat/fwd-decl 
More forward declaration for generic headers
 2020-12-13 01:12:05 +03:00
alexey-milovidov
2eabd41749
Merge pull request #17659 from nautaa/master 
add function to escape charaters for XML
 2020-12-12 23:43:41 +03:00
Azat Khuzhin
5b3ab48861 More forward declaration for generic headers 
The following headers are pretty generic, so use forward declaration as
much as possible:
- Context.h
- Settings.h
- ConnectionTimeouts.h
(Also this shows that some missing some includes -- this has been fixed)

And split ConnectionTimeouts.h into ConnectionTimeoutsContext.h (since
module part cannot be added for it, due to recursive build dependencies
that will be introduced)

Also remove Settings from the RemoteBlockInputStream/RemoteQueryExecutor
and just pass the context, since settings was passed only in speicifc
places, that can allow making a copy of Context (i.e. Copier).

Approx results (How much units will be recompiled after changing file X?):

- ConnectionTimeouts.h
  - mainline: 100

- Context.h:
  - mainline: ~800
  - patched:  415

- Settings.h:
  - mainline: 900-1K
  - patched:  440 (most of them because of the Context.h)
 2020-12-12 17:43:10 +03:00
Pavel Kovalenko
59a5e63417 Merge remote-tracking branch 'origin/master' into s3-adaptive-single-part-upload 
# Conflicts:
#	src/Disks/S3/DiskS3.cpp
#	src/Disks/S3/DiskS3.h
#	src/Disks/S3/registerDiskS3.cpp
#	src/IO/WriteBufferFromS3.cpp
#	src/IO/WriteBufferFromS3.h
 2020-12-11 18:28:41 +03:00
Kruglov Pavel
6300cd285f
Merge pull request #17909 from Jokser/disk-s3-send-metadata 
Ability to set metadata when put S3 object
 2020-12-11 17:01:14 +03:00
nauta
00dc104025 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse 2020-12-11 16:15:40 +08:00
alexey-milovidov
f7d1441858
Update WriteHelpers.h 2020-12-11 00:09:52 +03:00
nikitamikhaylov
17310c6c50 fix-arcadia 2020-12-10 21:08:16 +03:00
Kruglov Pavel
9a785dbbf5
Merge branch 'master' into disk-s3-send-metadata 2020-12-10 20:17:41 +03:00
nikitamikhaylov
955033d6a1 done 2020-12-10 16:18:37 +03:00
Vladimir Chebotarev
39d867e56d
Added proper authentication for S3 client (#16856) 2020-12-10 12:19:42 +03:00
Nikolai Kochetov
0e44a22f43 Fixing build. 2020-12-09 19:17:59 +03:00
Nikolai Kochetov
32b38f389e Merge branch 'master' into async-read-from-socket 2020-12-09 17:15:36 +03:00
Nikolai Kochetov
156f44808f Fixing crash. 2020-12-09 17:11:45 +03:00
Pavel Kovalenko
db7a87089b Adaptive choose of single/multi part upload in WriteBufferFromS3. 2020-12-09 17:09:04 +03:00
alexey-milovidov
e127636a4b
Merge pull request #16787 from kitaisreal/fast-float-integration 
FastFloat library integration
 2020-12-08 21:34:34 +03:00
Pavel Kovalenko
dfbb31174e Ability to set metadata when put S3 object 2020-12-08 21:31:57 +03:00
alexey-milovidov
ab10cb4bf9
Merge pull request #17707 from ClickHouse/quota-by-x-forwarded-for 
Allow quotas to be keyed by proxy-forwarded IP address; add support for PROXY protocol
 2020-12-08 14:48:05 +03:00
Nikolai Kochetov
7d77a7ba24
Merge pull request #16952 from Enmk/DateTime64_fixes_comparison 
Fixed comparison of DateTime64 with different scales
 2020-12-08 12:40:41 +03:00
Maksim Kita
a9a6517291 Fixed style 2020-12-07 19:26:38 +03:00
Alexey Milovidov
1ed329017b Merge branch 'master' into quota-by-x-forwarded-for 2020-12-07 18:22:19 +03:00
Maksim Kita
b0afa8488d Updated parse float precise implementation 2020-12-07 17:23:02 +03:00
Maksim Kita
c3864d2fbf Updated contrib CMakeLists 2020-12-07 14:08:19 +03:00
Maksim Kita
b6bfb1cf20 Use fast_float by default 2020-12-06 23:37:36 +03:00
Maksim Kita
5f410718ca Fix marker check 2020-12-06 23:37:35 +03:00
Maksim Kita
ccbfd52315 Fixed compile issues 2020-12-06 23:37:35 +03:00
Maksim Kita
095137b9f7 FastFloat conditional replace precise parsing 2020-12-06 23:37:35 +03:00
Maksim Kita
87c50602bc Fast float updated implementation 2020-12-06 23:37:35 +03:00
Maksim Kita
7d97f23db4 Fixed point 2020-12-06 23:37:35 +03:00
Maksim Kita
80d66b8868 FastFloat library integration 2020-12-06 23:37:35 +03:00
alexey-milovidov
878864602c
Merge pull request #17831 from kitaisreal/dragonbox-integration 
DragonBox integration
 2020-12-06 22:58:56 +03:00
alexey-milovidov
614420feb9
Merge pull request #17794 from excitoon-favorites/s3testiostream 
Attempt to use IOStream in AWS SDK
 2020-12-06 16:42:12 +03:00
nauta
8e615a1d8d Merge remote-tracking branch 'upstream/master' 2020-12-06 20:48:47 +08:00