thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-29 21:20:49 +00:00
Code Issues Packages Projects Releases Wiki Activity
77,455 Commits 8,956 Branches 1,767 Tags 1.8 GiB
cb6f99fe6f
Commit Graph

1123 Commits

Author SHA1 Message Date
Anton Ivashkin
527d33aa2b Fix gcc build, fix codestyle 2020-07-14 15:26:22 +03:00
alexey-milovidov
a45d9bba35
Merge pull request #12434 from excitoon-favorites/s3read 
`min_bytes_for_seek` setting for `DiskS3`
 2020-07-14 11:26:09 +03:00
Peng Jian
7579d65ebc Registering StorageS3 and TableFunctionS3 under two different names (S3 and COSN). 2020-07-13 22:13:30 +08:00
Anton Ivashkin
26fca949bd add profiling events from S3 request to system.events and system.query_log 2020-07-13 11:27:11 +03:00
Vladimir Chebotarev
820e95ae3c Added comments. 2020-07-13 07:15:37 +03:00
Alexey Milovidov
74f5e36b03 Merge branch 'master' into deprecate-special-zero-datetime 2020-07-13 04:51:24 +03:00
Alexey Milovidov
5afe441324 Whitespaces 2020-07-13 03:45:42 +03:00
Vladimir Chebotarev
ffde5f137b Minor fixes. 2020-07-13 03:27:51 +03:00
Vladimir Chebotarev
a479a20ba4 Review fixes. 2020-07-13 03:24:49 +03:00
Vladimir Chebotarev
4802a785b5 Added read_seek_threshold setting to DiskS3. 2020-07-13 02:51:25 +03:00
Vladimir Chebotarev
67f9d8124b Attempt to implement streaming optimization in DiskS3. 2020-07-13 02:47:22 +03:00
Vladimir Chebotarev
718523b0ee Working wrapper. 2020-07-13 02:47:22 +03:00
Alexey Milovidov
2249ecf6e8 Deprecate special printing of zero Date/DateTime 2020-07-12 23:10:04 +03:00
Alexey Milovidov
5ef8d49ebe Fix typo 2020-07-12 23:02:51 +03:00
alexey-milovidov
26d32f2ce5
Merge pull request #12412 from Jokser/s3-https 
S3 HTTPS integration tests
 2020-07-12 03:36:37 +03:00
Pavel Kovalenko
d3fa78392e Retrigger CI 2020-07-11 18:35:51 +03:00
Pavel Kovalenko
8b5f8c592f Add comment regarding proxy tunnel usage in PocoHTTPClient.cpp 2020-07-11 15:43:30 +03:00
Pavel Kovalenko
f43428a4d5 S3 HTTPS integration test. 2020-07-10 22:42:18 +03:00
Peng Jian
958bb1f3aa COS (Tencent Cloud Object Storage) integration 
To allow import and export to COS.
 2020-07-10 15:26:55 +08:00
Vladimir Chebotarev
faf6be6576
Implemented single part uploads for DiskS3 (#12026) 
* Implemented single part uploads for DiskS3.
* Added `min_multi_part_upload_size` to disk configuration.
 2020-07-09 17:09:17 +03:00
tavplubix
33c3545125
Merge pull request #12197 from nikitamikhaylov/csv-file-bugfix 
Headers for CSVWithNames in StorageFile
 2020-07-08 20:42:49 +03:00
Anton Ivashkin
78ba9c986f throw exception on redirect limit in S3 request 2020-07-07 16:20:48 +03:00
Nikita Mikhaylov
270551e599 done 2020-07-07 14:45:20 +03:00
flynn
5816858403
add parseDateTimeBestEffortUS function (#12028) 
* add function parseDateTimeBestEffortUS
* add test
* add doc

Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
 2020-07-05 21:09:20 +03:00
Vladimir Chebotarev
a541683efa Moved useless S3 logging to TRACE level. 2020-07-01 01:04:30 +03:00
Alexander Kuzmenkov
d77f397b38 review fixes 2020-06-26 03:18:33 +03:00
Alexander Kuzmenkov
059a2704d0 Add CPU frequencies to system.asynchronous_metrics 2020-06-25 23:43:57 +03:00
alexey-milovidov
9de5db9025
Merge pull request #11856 from zhang2014/feature/uuid_without_separator 
Support parse UUID without separator
 2020-06-25 16:26:55 +03:00
zhang2014
c3a38e7f8c apply review suggestions 2020-06-23 11:15:55 +08:00
Alexey Milovidov
1191679965 Fix wrong code 2020-06-23 00:54:19 +03:00
Alexey Milovidov
4ace4b4c75 Fix bugs in DateTime64 parsing 2020-06-22 23:54:36 +03:00
zhang2014
b820cfb3b6 fix read extra bytes when with separator 2020-06-22 21:30:55 +08:00
zhang2014
ee2ca536ff try fix build failure 2020-06-22 20:01:54 +08:00
zhang2014
b3ef9a90e9 Support parse uuid without separator 2020-06-22 17:31:30 +08:00
alexey-milovidov
59d3e200ce
Merge pull request #11831 from ClickHouse/decimal-cut-extra-digits-after-point 
Make reading of Decimal more compatible with other DBMS
 2020-06-21 21:03:06 +03:00
Alexey Milovidov
814c1019b2 Fix build after merge 2020-06-21 14:41:06 +03:00
alexey-milovidov
4ee623ccac
Merge pull request #10242 from MovElb/movelb-postgresql-wire-protocol-impl 
PostgreSQL wire protocol implementation
 2020-06-21 14:39:22 +03:00
alexey-milovidov
f4a1872085
Update WriteHelpers.h 2020-06-21 14:32:54 +03:00
Alexey Milovidov
4b7d253c8a Fix clang-static-analyzer 2020-06-21 13:51:51 +03:00
Alexey Milovidov
227afea032 Merge branch 'master' into decimal-cut-extra-digits-after-point 2020-06-21 13:50:06 +03:00
alexey-milovidov
c8eabd8cec
Merge pull request #11829 from ClickHouse/improve-error-message-decimal-cast 
Improve error message for Decimal CAST
 2020-06-21 00:24:03 +03:00
Alexey Milovidov
6111cbec7f Trying to fix clang-static-analyzer 2020-06-20 20:10:16 +03:00
Alexey Milovidov
408fc241d6 Make reading of Decimal more compatible with other DBMS 2020-06-20 17:43:01 +03:00
Alexey Milovidov
7b2b726c17 Fix bad types 2020-06-20 17:00:38 +03:00
Alexey Milovidov
d9e7fe3735 Improve error message for Decimal CAST 2020-06-20 16:34:22 +03:00
Mikhail Filimonov
9609bd9dee Kafka better states, formats based on PeekableReadBuffer, and other minor fixes. 
Add formats tests, fixes for JSONCompactEachRowWithNamesAndTypes, TSVWithNamesAndTypes. Some CR fixes
Add sanitizing for kafka_max_block_size and kafka_poll_max_batch_size
 2020-06-19 10:49:05 +02:00
Alexey Milovidov
cf0bd501e5 Remove harmful default values from code 2020-06-16 01:36:12 +03:00
Alexey Milovidov
186d336e31 Use proper timeouts when communicating with xdbc-bridge 2020-06-16 01:35:15 +03:00
Nikita Mikhaylov
9df693ced5
Merge pull request #11561 from Jokser/s3-http-client-memory-optimization 
Avoid copying whole response stream into memory in S3 HTTP client.
 2020-06-10 16:53:33 +04:00
Pavel Kovalenko
f623ef635b Avoid copying whole response stream into memory in S3 HTTP client. 2020-06-09 18:26:51 +03:00
alesapin
a6feb81af1 Fix under msan 2020-06-09 18:11:11 +03:00
alesapin
981462db04 Remove dump flag from ReadBufferAIO 2020-06-09 18:01:34 +03:00
Alexey Milovidov
475af33319 Avoid too large stack frames 2020-06-08 20:35:45 +03:00
alexey-milovidov
e3c528e661
Merge pull request #11174 from excitoon-favorites/s3tests 
Added tests for improved S3 URL parsing
 2020-06-07 02:44:40 +03:00
alesapin
22235c1951 Tiny fixes for storage s3 2020-06-04 16:48:20 +03:00
Vladimir Chebotarev
423db7e39a Added tests for improved S3 URL parsing. 2020-06-04 16:12:04 +03:00
Pervakov Grigorii
bc9381406f Add default credentials and custom headers for s3 table functions. 2020-06-02 20:48:49 +03:00
Alexey Milovidov
7fa1366a4a Fix build after merge #11230 2020-06-01 01:25:37 +03:00
alexey-milovidov
256f84ddc2
Merge pull request #11230 from Jokser/s3-poco-http-client 
S3 Poco Http Client
 2020-06-01 01:20:21 +03:00
Alexey Milovidov
25f941020b Remove namespace pollution 2020-05-31 00:57:37 +03:00
Alexey Milovidov
5aff138956 Preparation for structured logging 2020-05-31 00:35:52 +03:00
MovElb
b4b5c90343 squash 2020-05-30 20:05:05 +03:00
Alexey Milovidov
b78c48310b Whitespaces 2020-05-30 01:37:44 +03:00
Pavel Kovalenko
51be859b16 S3 Poco HTTP Client WIP (timeouts + proxy support). 2020-05-28 19:11:27 +03:00
Pavel Kovalenko
29a5804342 S3 Poco HTTP Client WIP (rewind buffer). 2020-05-28 12:46:31 +03:00
Pavel Kovalenko
677cb56a06 S3 Poco HTTP Client WIP. 2020-05-27 22:41:49 +03:00
Pavel Kovalenko
a2dccc778c S3 Poco HTTP Client WIP (redirect support). 2020-05-27 19:56:17 +03:00
Pavel Kovalenko
2b07f69e57 S3 Poco HTTP Client WIP. 2020-05-27 18:02:25 +03:00
Alexey Milovidov
fb4089ab8e Fix error 2020-05-27 00:48:29 +03:00
Alexey Milovidov
b2057159c1 Experiment on parsing backslash escapes in a more convenient way #10922 2020-05-26 17:24:20 +03:00
alexey-milovidov
bee5849c6a
Merge pull request #11137 from ClickHouse/logger-fmt 
fmt-style logging, part 1
 2020-05-25 01:38:14 +03:00
Alexey Milovidov
7fca4ce4d0 Added missing test @excitoon #11036 2020-05-24 13:44:03 +03:00
Alexey Milovidov
e3cd085230 Fix test (looks like it was incorrect) 2020-05-24 13:42:13 +03:00
Alexey Milovidov
7e1813825b Return old names of macros 2020-05-24 01:24:01 +03:00
Alexey Milovidov
7c0c328a35 Progress on task 2020-05-24 00:05:47 +03:00
Alexey Milovidov
cd6d3c7509 Progress on task 2020-05-23 22:55:06 +03:00
Alexey Milovidov
eacff92d0e Progress on task 2020-05-23 22:35:08 +03:00
Alexey Milovidov
86b4d5a86f Remove duplicate whitespaces (preparation) 2020-05-23 22:09:06 +03:00
Alexey Milovidov
ab0562a574 Make all LOG in single line (preparation) 2020-05-23 22:05:41 +03:00
Alexey Milovidov
57f6dc66d3 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" \+ [^+]+ \+ "[^"]+" \+ [^+]+ \+ "[^"]+" \+ [^+]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" \+ ([^+]+) \+ "([^"]+)" \+ ([^+]+) \+ "([^"]+)" \+ ([^+]+)\);/\1_FORMATTED(\2, "\3{}\5{}\7{}", \4, \6, \8);/' 2020-05-23 20:11:09 +03:00
Alexey Milovidov
533f86278a find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5{}\7", \4, \6);/' 2020-05-23 20:00:41 +03:00
Alexey Milovidov
ee4ffbc332 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}", \4);/' 2020-05-23 19:47:56 +03:00
Alexey Milovidov
8d2e80a5e2 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+"\)' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+, "[^"]+")\)/\1_FORMATTED(\2)/' 2020-05-23 19:42:39 +03:00
Alexey Milovidov
35d79e1252 fmt-style logging, part 1 2020-05-23 19:33:07 +03:00
alexey-milovidov
ac6deaf8ec
Merge pull request #11036 from excitoon-favorites/s3fixes 
Fixed parsing of S3 URL
 2020-05-23 17:06:59 +03:00
Vitaly Baranov
5a0f356cd6
Merge pull request #11038 from Enmk/parseDateTime64BestEffort_fix 
Fixed parseDateTime64BestEffort implementation
 2020-05-22 14:40:39 +03:00
Vladimir Chebotarev
98f31374d5 Added improved S3 URL parsing to DiskS3. 2020-05-22 11:18:34 +03:00
Vladimir Chebotarev
02cb08ea2f Fixed parsing of S3 URL. 2020-05-22 11:17:10 +03:00
Vasily Nemkov
403aae9126 Fixed parseDateTime64BestEffort implementation 
Fixed argument resolution issues.
Added tests and made sure -orNull and -orZero variants alwo work correctly.
 2020-05-21 17:21:39 +03:00
Azat Khuzhin
d93b9a57f6 Forward declaration for Context as much as possible. 
Now after changing Context.h 488 modules will be recompiled instead of 582.
 2020-05-21 01:53:18 +03:00
Azat Khuzhin
ec1aff245a Add an assert() in case of write into a file after close 2020-05-16 01:13:15 +03:00
Ivan
85d783c247
Poco contrib refactoring (#10396) 
* Remove config_common.h
* Refactor libcpuid contrib
* Remove support for libcpuinfo
* Define USE_CPUID in Arcadia
* Refactor Poco libraries
 2020-05-08 17:11:19 +03:00
Alexey Milovidov
abe40e2127 Added required comment #10576 2020-05-03 01:34:50 +03:00
alexey-milovidov
a235533d5f
Merge pull request #10576 from Jokser/s3-with-dynamic-proxies 
S3 with dynamic proxy configuration
 2020-05-03 01:25:13 +03:00
alexey-milovidov
9011d18b80
Update S3Common.h 2020-05-03 01:25:02 +03:00
alexey-milovidov
342ed093de
Update S3Common.cpp 2020-05-02 23:46:39 +03:00
alexey-milovidov
250a44a47f
Merge pull request #10607 from Avogar/json_as_string_format 
Add JSONAsStringRowInputFormat
 2020-05-02 22:17:22 +03:00
Avogar
9670e74885 Update makeContinuousMemoryFromCheckpointToPos in PeekableReadBuffer. 2020-05-01 19:42:15 +03:00
Pavel Kovalenko
a1acbcb019 Code style fixes. 2020-04-29 11:45:13 +03:00
Pavel Kovalenko
2ecf4b5a23 Dynamic proxy configuration for DiskS3. 2020-04-29 11:40:29 +03:00
Alexander Tokmakov
53dcce55e9 better diagnostic info in input formats 2020-04-24 15:03:48 +03:00
alexey-milovidov
79d531af87
Merge pull request #10466 from ClickHouse/aku/arena-infinite-loop 
Work around a bug leading to an infinite loop in addressToLine
 2020-04-24 10:38:07 +03:00
Alexander Kuzmenkov
2bedc82c18 Work around a bug leading to an infinite loop in addressToLine. 
Fixing this is hopeless and would entail rewriting the entire
WriteBuffer thing, and also this hack is something we can backport.
 2020-04-24 02:42:04 +03:00
Alexey Milovidov
be22a4b94e Checkpoint 2020-04-22 08:39:31 +03:00
alexey-milovidov
17e7d4d88a
Merge pull request #10307 from abyss7/arcadia-4 
Changes for auto-sync with Arcadia
 2020-04-17 05:08:34 +03:00
Ivan Lezhankin
e230632645 Changes required for auto-sync with Arcadia 2020-04-16 15:31:57 +03:00
Artem Zuikov
739daf3bbe Merge branch 'master' into strange 2020-04-15 20:55:21 +03:00
Alexey Milovidov
738fef71f4 Allow to parse +inf #1839 2020-04-15 06:32:33 +03:00
Artem Zuikov
24f715ad87 tech debt 2020-04-14 17:43:09 +03:00
alexey-milovidov
3f1658c0e9
Update parseDateTimeBestEffort.cpp 2020-04-12 22:35:23 +03:00
Alexey Milovidov
142087c4f7 Fix "parseDateTimeBestEffort" for strings in RFC-2822 when day of week is Thuesday or Thursday #10082 2020-04-12 22:34:04 +03:00
Alexey Milovidov
8cb4dd275a Remove default argument (harmful) #10082 2020-04-12 22:23:59 +03:00
Alexey Milovidov
d4a3ef2fdc Fixed wrong code (no changes in behaviour) 2020-04-12 19:16:02 +03:00
Alexey Milovidov
39bbc1071b Fix typo 2020-04-10 20:23:51 +03:00
Pavel Kovalenko
3603c98c81 Move gtest for S3 URI to proper folder. 2020-04-08 14:59:24 +03:00
Pavel Kovalenko
9b1c5c8b51 Fix regex for S3 URI to pass clang-tidy check. 2020-04-08 11:44:26 +03:00
alexey-milovidov
401c52524b
Merge pull request #9998 from Jokser/s3-uri-virtual-hosted-style-support 
Virtual hosted-style support for S3 URI
 2020-04-08 03:51:28 +03:00
alexey-milovidov
37fe63f8d8
Update S3Common.cpp 2020-04-08 03:49:09 +03:00
Alexander Kuzmenkov
385e8839dc
Quote expected strings in parse error messages 2020-04-07 17:15:14 +03:00
Ivan
f6b31f344d
Add cross-compile build for FreeBSD (#9643) 
* Add toolchain to Docker image
 2020-04-07 11:33:49 +03:00
Pavel Kovalenko
8c1dda0105 Merge remote-tracking branch 'jokser/s3-uri-virtual-hosted-style-support' into s3-uri-virtual-hosted-style-support 2020-04-06 12:59:59 +03:00
Pavel Kovalenko
f9c98dd689 Merge remote-tracking branch 'origin/master' into s3-uri-virtual-hosted-style-support 2020-04-06 12:57:53 +03:00
Ivan Lezhankin
06446b4f08 dbms/ → src/ 2020-04-03 18:14:31 +03:00