thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-17 21:24:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
76,441 Commits 9,139 Branches 1,774 Tags 2.1 GiB
175f903624
Commit Graph

1100 Commits

Author SHA1 Message Date
Vitaly Baranov
18b21511a9
Merge pull request #13013 from vitlibar/implement-custom-settings 
Implement custom settings
 2020-08-02 05:01:14 +03:00
Alexey Milovidov
9e97aab3b3 Whitespace 2020-08-02 05:00:52 +03:00
Alexey Milovidov
d3c0635fc0 Merge branch 'master' into stack-frams-size-limit 2020-08-02 04:35:09 +03:00
alexey-milovidov
56a974049e
Merge pull request #13158 from ClickHouse/amosbird-fm 
Merge #12574
 2020-08-02 01:48:57 +03:00
Alexey Milovidov
07f3662f6d Merge remote-tracking branch 'origin/master' into deprecate-special-zero-datetime 2020-07-31 23:49:06 +03:00
Vitaly Baranov
80a3caef1c Allow using any types for custom fields. 2020-07-31 20:57:49 +03:00
Vitaly Baranov
300727afa3 Rework the StringField* classes and make conversion String => StringField* explicit. 2020-07-31 19:11:27 +03:00
Vitaly Baranov
cd372de417 Use SettingUInt64 only in Settings, use UInt64 in other places. 2020-07-31 19:11:27 +03:00
Alexander Kuzmenkov
efb09d7ff5 Cleanup for #12999. NFC. 2020-07-31 17:53:41 +03:00
Alexey Milovidov
67b7a5442f Merge branch 'fm' of https://github.com/amosbird/ClickHouse into amosbird-fm 2020-07-31 02:43:27 +03:00
Alexey Milovidov
83c9d9ef45 Merge branch 'master' into deprecate-special-zero-datetime 2020-07-31 00:17:04 +03:00
Nikita Mikhaylov
1d6c2ba689 rewrite other test + remove useless includes 2020-07-29 20:37:57 +03:00
Amos Bird
b30240efc0
formatRow function 2020-07-28 22:43:43 +08:00
Alexey Milovidov
50bbfc848d Merge branch 'master' into stack-frams-size-limit 2020-07-21 14:45:15 +03:00
Vitaly Baranov
0b17595a91
Merge pull request #12423 from vitlibar/update-simdjson 
Update simdjson
 2020-07-20 10:15:38 +03:00
Vitaly Baranov
61e43c3ef9 Make conversion std::string_view => StringRef explicit. 2020-07-19 12:50:24 +03:00
Alexey Milovidov
e207acf19a Merge branch 'master' into deprecate-special-zero-datetime 2020-07-17 17:06:31 +03:00
alexey-milovidov
9fb40a3f7b
Merge pull request #12386 from fastio/master 
COS (Tencent Cloud Object Storage) integration
 2020-07-17 14:09:16 +03:00
alexey-milovidov
f3db2f3c3d
Update S3Common.cpp 2020-07-17 14:07:26 +03:00
Peng Jian
2fc58e8f10 Fix code sytle check & build check 2020-07-17 11:33:29 +08:00
Alexey Milovidov
7a8bd40c2c Merge branch 'master' into deprecate-special-zero-datetime 2020-07-16 03:21:21 +03:00
Alexander Kuzmenkov
f785837b1d
Merge pull request #12518 from ClickHouse/aku/android 
Some provisions for Android build
 2020-07-15 22:05:41 +03:00
alexey-milovidov
e7cf3f4e70
Merge pull request #12464 from ianton-ru/s3_profile_events 
add profiling events from S3 request to system.events and system.quer…
 2020-07-15 19:33:15 +03:00
Vladimir Chebotarev
ed4da4bec6
Separated AWSAuthV4Signer into different logger, removed "AWSClient: AWSClient" (#12320) 2020-07-15 17:16:45 +03:00
Alexander Kuzmenkov
3e6b9f297f Some provisions for Android build 2020-07-15 14:16:00 +03:00
Anton Ivashkin
fbd80e8d67 Fix codestyle 2020-07-15 14:15:12 +03:00
Anton Ivashkin
52fea6a5a3 Merge master 2020-07-14 15:56:38 +03:00
Anton Ivashkin
527d33aa2b Fix gcc build, fix codestyle 2020-07-14 15:26:22 +03:00
alexey-milovidov
a45d9bba35
Merge pull request #12434 from excitoon-favorites/s3read 
`min_bytes_for_seek` setting for `DiskS3`
 2020-07-14 11:26:09 +03:00
Peng Jian
7579d65ebc Registering StorageS3 and TableFunctionS3 under two different names (S3 and COSN). 2020-07-13 22:13:30 +08:00
Anton Ivashkin
26fca949bd add profiling events from S3 request to system.events and system.query_log 2020-07-13 11:27:11 +03:00
Vladimir Chebotarev
820e95ae3c Added comments. 2020-07-13 07:15:37 +03:00
Alexey Milovidov
74f5e36b03 Merge branch 'master' into deprecate-special-zero-datetime 2020-07-13 04:51:24 +03:00
Alexey Milovidov
5afe441324 Whitespaces 2020-07-13 03:45:42 +03:00
Vladimir Chebotarev
ffde5f137b Minor fixes. 2020-07-13 03:27:51 +03:00
Vladimir Chebotarev
a479a20ba4 Review fixes. 2020-07-13 03:24:49 +03:00
Vladimir Chebotarev
4802a785b5 Added read_seek_threshold setting to DiskS3. 2020-07-13 02:51:25 +03:00
Vladimir Chebotarev
67f9d8124b Attempt to implement streaming optimization in DiskS3. 2020-07-13 02:47:22 +03:00
Vladimir Chebotarev
718523b0ee Working wrapper. 2020-07-13 02:47:22 +03:00
Alexey Milovidov
2249ecf6e8 Deprecate special printing of zero Date/DateTime 2020-07-12 23:10:04 +03:00
Alexey Milovidov
5ef8d49ebe Fix typo 2020-07-12 23:02:51 +03:00
alexey-milovidov
26d32f2ce5
Merge pull request #12412 from Jokser/s3-https 
S3 HTTPS integration tests
 2020-07-12 03:36:37 +03:00
Pavel Kovalenko
d3fa78392e Retrigger CI 2020-07-11 18:35:51 +03:00
Pavel Kovalenko
8b5f8c592f Add comment regarding proxy tunnel usage in PocoHTTPClient.cpp 2020-07-11 15:43:30 +03:00
Pavel Kovalenko
f43428a4d5 S3 HTTPS integration test. 2020-07-10 22:42:18 +03:00
Peng Jian
958bb1f3aa COS (Tencent Cloud Object Storage) integration 
To allow import and export to COS.
 2020-07-10 15:26:55 +08:00
Vladimir Chebotarev
faf6be6576
Implemented single part uploads for DiskS3 (#12026) 
* Implemented single part uploads for DiskS3.
* Added `min_multi_part_upload_size` to disk configuration.
 2020-07-09 17:09:17 +03:00
tavplubix
33c3545125
Merge pull request #12197 from nikitamikhaylov/csv-file-bugfix 
Headers for CSVWithNames in StorageFile
 2020-07-08 20:42:49 +03:00
Anton Ivashkin
78ba9c986f throw exception on redirect limit in S3 request 2020-07-07 16:20:48 +03:00
Nikita Mikhaylov
270551e599 done 2020-07-07 14:45:20 +03:00
flynn
5816858403
add parseDateTimeBestEffortUS function (#12028) 
* add function parseDateTimeBestEffortUS
* add test
* add doc

Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
 2020-07-05 21:09:20 +03:00
Vladimir Chebotarev
a541683efa Moved useless S3 logging to TRACE level. 2020-07-01 01:04:30 +03:00
Alexander Kuzmenkov
d77f397b38 review fixes 2020-06-26 03:18:33 +03:00
Alexander Kuzmenkov
059a2704d0 Add CPU frequencies to system.asynchronous_metrics 2020-06-25 23:43:57 +03:00
alexey-milovidov
9de5db9025
Merge pull request #11856 from zhang2014/feature/uuid_without_separator 
Support parse UUID without separator
 2020-06-25 16:26:55 +03:00
zhang2014
c3a38e7f8c apply review suggestions 2020-06-23 11:15:55 +08:00
Alexey Milovidov
1191679965 Fix wrong code 2020-06-23 00:54:19 +03:00
Alexey Milovidov
4ace4b4c75 Fix bugs in DateTime64 parsing 2020-06-22 23:54:36 +03:00
zhang2014
b820cfb3b6 fix read extra bytes when with separator 2020-06-22 21:30:55 +08:00
zhang2014
ee2ca536ff try fix build failure 2020-06-22 20:01:54 +08:00
zhang2014
b3ef9a90e9 Support parse uuid without separator 2020-06-22 17:31:30 +08:00
alexey-milovidov
59d3e200ce
Merge pull request #11831 from ClickHouse/decimal-cut-extra-digits-after-point 
Make reading of Decimal more compatible with other DBMS
 2020-06-21 21:03:06 +03:00
Alexey Milovidov
814c1019b2 Fix build after merge 2020-06-21 14:41:06 +03:00
alexey-milovidov
4ee623ccac
Merge pull request #10242 from MovElb/movelb-postgresql-wire-protocol-impl 
PostgreSQL wire protocol implementation
 2020-06-21 14:39:22 +03:00
alexey-milovidov
f4a1872085
Update WriteHelpers.h 2020-06-21 14:32:54 +03:00
Alexey Milovidov
4b7d253c8a Fix clang-static-analyzer 2020-06-21 13:51:51 +03:00
Alexey Milovidov
227afea032 Merge branch 'master' into decimal-cut-extra-digits-after-point 2020-06-21 13:50:06 +03:00
alexey-milovidov
c8eabd8cec
Merge pull request #11829 from ClickHouse/improve-error-message-decimal-cast 
Improve error message for Decimal CAST
 2020-06-21 00:24:03 +03:00
Alexey Milovidov
6111cbec7f Trying to fix clang-static-analyzer 2020-06-20 20:10:16 +03:00
Alexey Milovidov
408fc241d6 Make reading of Decimal more compatible with other DBMS 2020-06-20 17:43:01 +03:00
Alexey Milovidov
7b2b726c17 Fix bad types 2020-06-20 17:00:38 +03:00
Alexey Milovidov
d9e7fe3735 Improve error message for Decimal CAST 2020-06-20 16:34:22 +03:00
Mikhail Filimonov
9609bd9dee Kafka better states, formats based on PeekableReadBuffer, and other minor fixes. 
Add formats tests, fixes for JSONCompactEachRowWithNamesAndTypes, TSVWithNamesAndTypes. Some CR fixes
Add sanitizing for kafka_max_block_size and kafka_poll_max_batch_size
 2020-06-19 10:49:05 +02:00
Alexey Milovidov
cf0bd501e5 Remove harmful default values from code 2020-06-16 01:36:12 +03:00
Alexey Milovidov
186d336e31 Use proper timeouts when communicating with xdbc-bridge 2020-06-16 01:35:15 +03:00
Nikita Mikhaylov
9df693ced5
Merge pull request #11561 from Jokser/s3-http-client-memory-optimization 
Avoid copying whole response stream into memory in S3 HTTP client.
 2020-06-10 16:53:33 +04:00
Pavel Kovalenko
f623ef635b Avoid copying whole response stream into memory in S3 HTTP client. 2020-06-09 18:26:51 +03:00
alesapin
a6feb81af1 Fix under msan 2020-06-09 18:11:11 +03:00
alesapin
981462db04 Remove dump flag from ReadBufferAIO 2020-06-09 18:01:34 +03:00
Alexey Milovidov
475af33319 Avoid too large stack frames 2020-06-08 20:35:45 +03:00
alexey-milovidov
e3c528e661
Merge pull request #11174 from excitoon-favorites/s3tests 
Added tests for improved S3 URL parsing
 2020-06-07 02:44:40 +03:00
alesapin
22235c1951 Tiny fixes for storage s3 2020-06-04 16:48:20 +03:00
Vladimir Chebotarev
423db7e39a Added tests for improved S3 URL parsing. 2020-06-04 16:12:04 +03:00
Pervakov Grigorii
bc9381406f Add default credentials and custom headers for s3 table functions. 2020-06-02 20:48:49 +03:00
Alexey Milovidov
7fa1366a4a Fix build after merge #11230 2020-06-01 01:25:37 +03:00
alexey-milovidov
256f84ddc2
Merge pull request #11230 from Jokser/s3-poco-http-client 
S3 Poco Http Client
 2020-06-01 01:20:21 +03:00
Alexey Milovidov
25f941020b Remove namespace pollution 2020-05-31 00:57:37 +03:00
Alexey Milovidov
5aff138956 Preparation for structured logging 2020-05-31 00:35:52 +03:00
MovElb
b4b5c90343 squash 2020-05-30 20:05:05 +03:00
Alexey Milovidov
b78c48310b Whitespaces 2020-05-30 01:37:44 +03:00
Pavel Kovalenko
51be859b16 S3 Poco HTTP Client WIP (timeouts + proxy support). 2020-05-28 19:11:27 +03:00
Pavel Kovalenko
29a5804342 S3 Poco HTTP Client WIP (rewind buffer). 2020-05-28 12:46:31 +03:00
Pavel Kovalenko
677cb56a06 S3 Poco HTTP Client WIP. 2020-05-27 22:41:49 +03:00
Pavel Kovalenko
a2dccc778c S3 Poco HTTP Client WIP (redirect support). 2020-05-27 19:56:17 +03:00
Pavel Kovalenko
2b07f69e57 S3 Poco HTTP Client WIP. 2020-05-27 18:02:25 +03:00
Alexey Milovidov
fb4089ab8e Fix error 2020-05-27 00:48:29 +03:00
Alexey Milovidov
b2057159c1 Experiment on parsing backslash escapes in a more convenient way #10922 2020-05-26 17:24:20 +03:00
alexey-milovidov
bee5849c6a
Merge pull request #11137 from ClickHouse/logger-fmt 
fmt-style logging, part 1
 2020-05-25 01:38:14 +03:00
Alexey Milovidov
7fca4ce4d0 Added missing test @excitoon #11036 2020-05-24 13:44:03 +03:00
Alexey Milovidov
e3cd085230 Fix test (looks like it was incorrect) 2020-05-24 13:42:13 +03:00
Alexey Milovidov
7e1813825b Return old names of macros 2020-05-24 01:24:01 +03:00
Alexey Milovidov
7c0c328a35 Progress on task 2020-05-24 00:05:47 +03:00
Alexey Milovidov
cd6d3c7509 Progress on task 2020-05-23 22:55:06 +03:00
Alexey Milovidov
eacff92d0e Progress on task 2020-05-23 22:35:08 +03:00
Alexey Milovidov
86b4d5a86f Remove duplicate whitespaces (preparation) 2020-05-23 22:09:06 +03:00
Alexey Milovidov
ab0562a574 Make all LOG in single line (preparation) 2020-05-23 22:05:41 +03:00
Alexey Milovidov
57f6dc66d3 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" \+ [^+]+ \+ "[^"]+" \+ [^+]+ \+ "[^"]+" \+ [^+]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" \+ ([^+]+) \+ "([^"]+)" \+ ([^+]+) \+ "([^"]+)" \+ ([^+]+)\);/\1_FORMATTED(\2, "\3{}\5{}\7{}", \4, \6, \8);/' 2020-05-23 20:11:09 +03:00
Alexey Milovidov
533f86278a find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5{}\7", \4, \6);/' 2020-05-23 20:00:41 +03:00
Alexey Milovidov
ee4ffbc332 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}", \4);/' 2020-05-23 19:47:56 +03:00
Alexey Milovidov
8d2e80a5e2 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+"\)' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+, "[^"]+")\)/\1_FORMATTED(\2)/' 2020-05-23 19:42:39 +03:00
Alexey Milovidov
35d79e1252 fmt-style logging, part 1 2020-05-23 19:33:07 +03:00
alexey-milovidov
ac6deaf8ec
Merge pull request #11036 from excitoon-favorites/s3fixes 
Fixed parsing of S3 URL
 2020-05-23 17:06:59 +03:00
Vitaly Baranov
5a0f356cd6
Merge pull request #11038 from Enmk/parseDateTime64BestEffort_fix 
Fixed parseDateTime64BestEffort implementation
 2020-05-22 14:40:39 +03:00
Vladimir Chebotarev
98f31374d5 Added improved S3 URL parsing to DiskS3. 2020-05-22 11:18:34 +03:00
Vladimir Chebotarev
02cb08ea2f Fixed parsing of S3 URL. 2020-05-22 11:17:10 +03:00
Vasily Nemkov
403aae9126 Fixed parseDateTime64BestEffort implementation 
Fixed argument resolution issues.
Added tests and made sure -orNull and -orZero variants alwo work correctly.
 2020-05-21 17:21:39 +03:00
Azat Khuzhin
d93b9a57f6 Forward declaration for Context as much as possible. 
Now after changing Context.h 488 modules will be recompiled instead of 582.
 2020-05-21 01:53:18 +03:00
Azat Khuzhin
ec1aff245a Add an assert() in case of write into a file after close 2020-05-16 01:13:15 +03:00
Ivan
85d783c247
Poco contrib refactoring (#10396) 
* Remove config_common.h
* Refactor libcpuid contrib
* Remove support for libcpuinfo
* Define USE_CPUID in Arcadia
* Refactor Poco libraries
 2020-05-08 17:11:19 +03:00
Alexey Milovidov
abe40e2127 Added required comment #10576 2020-05-03 01:34:50 +03:00
alexey-milovidov
a235533d5f
Merge pull request #10576 from Jokser/s3-with-dynamic-proxies 
S3 with dynamic proxy configuration
 2020-05-03 01:25:13 +03:00
alexey-milovidov
9011d18b80
Update S3Common.h 2020-05-03 01:25:02 +03:00
alexey-milovidov
342ed093de
Update S3Common.cpp 2020-05-02 23:46:39 +03:00
alexey-milovidov
250a44a47f
Merge pull request #10607 from Avogar/json_as_string_format 
Add JSONAsStringRowInputFormat
 2020-05-02 22:17:22 +03:00
Avogar
9670e74885 Update makeContinuousMemoryFromCheckpointToPos in PeekableReadBuffer. 2020-05-01 19:42:15 +03:00
Pavel Kovalenko
a1acbcb019 Code style fixes. 2020-04-29 11:45:13 +03:00
Pavel Kovalenko
2ecf4b5a23 Dynamic proxy configuration for DiskS3. 2020-04-29 11:40:29 +03:00
Alexander Tokmakov
53dcce55e9 better diagnostic info in input formats 2020-04-24 15:03:48 +03:00
alexey-milovidov
79d531af87
Merge pull request #10466 from ClickHouse/aku/arena-infinite-loop 
Work around a bug leading to an infinite loop in addressToLine
 2020-04-24 10:38:07 +03:00
Alexander Kuzmenkov
2bedc82c18 Work around a bug leading to an infinite loop in addressToLine. 
Fixing this is hopeless and would entail rewriting the entire
WriteBuffer thing, and also this hack is something we can backport.
 2020-04-24 02:42:04 +03:00
Alexey Milovidov
be22a4b94e Checkpoint 2020-04-22 08:39:31 +03:00
alexey-milovidov
17e7d4d88a
Merge pull request #10307 from abyss7/arcadia-4 
Changes for auto-sync with Arcadia
 2020-04-17 05:08:34 +03:00
Ivan Lezhankin
e230632645 Changes required for auto-sync with Arcadia 2020-04-16 15:31:57 +03:00
Artem Zuikov
739daf3bbe Merge branch 'master' into strange 2020-04-15 20:55:21 +03:00
Alexey Milovidov
738fef71f4 Allow to parse +inf #1839 2020-04-15 06:32:33 +03:00
Artem Zuikov
24f715ad87 tech debt 2020-04-14 17:43:09 +03:00
alexey-milovidov
3f1658c0e9
Update parseDateTimeBestEffort.cpp 2020-04-12 22:35:23 +03:00
Alexey Milovidov
142087c4f7 Fix "parseDateTimeBestEffort" for strings in RFC-2822 when day of week is Thuesday or Thursday #10082 2020-04-12 22:34:04 +03:00
Alexey Milovidov
8cb4dd275a Remove default argument (harmful) #10082 2020-04-12 22:23:59 +03:00
Alexey Milovidov
d4a3ef2fdc Fixed wrong code (no changes in behaviour) 2020-04-12 19:16:02 +03:00
Alexey Milovidov
39bbc1071b Fix typo 2020-04-10 20:23:51 +03:00
Pavel Kovalenko
3603c98c81 Move gtest for S3 URI to proper folder. 2020-04-08 14:59:24 +03:00
Pavel Kovalenko
9b1c5c8b51 Fix regex for S3 URI to pass clang-tidy check. 2020-04-08 11:44:26 +03:00
alexey-milovidov
401c52524b
Merge pull request #9998 from Jokser/s3-uri-virtual-hosted-style-support 
Virtual hosted-style support for S3 URI
 2020-04-08 03:51:28 +03:00
alexey-milovidov
37fe63f8d8
Update S3Common.cpp 2020-04-08 03:49:09 +03:00
Alexander Kuzmenkov
385e8839dc
Quote expected strings in parse error messages 2020-04-07 17:15:14 +03:00
Ivan
f6b31f344d
Add cross-compile build for FreeBSD (#9643) 
* Add toolchain to Docker image
 2020-04-07 11:33:49 +03:00
Pavel Kovalenko
8c1dda0105 Merge remote-tracking branch 'jokser/s3-uri-virtual-hosted-style-support' into s3-uri-virtual-hosted-style-support 2020-04-06 12:59:59 +03:00
Pavel Kovalenko
f9c98dd689 Merge remote-tracking branch 'origin/master' into s3-uri-virtual-hosted-style-support 2020-04-06 12:57:53 +03:00
Ivan Lezhankin
06446b4f08 dbms/ → src/ 2020-04-03 18:14:31 +03:00