Commit Graph

1207 Commits

Author SHA1 Message Date
Vasily Nemkov
5ff7baf663 Fixed comparing Date and DateTime64
With a less flakky test
2020-12-18 17:47:08 +02:00
Amos Bird
272311f6bd
Extensive information in system.query_log 2020-12-18 14:13:58 +08:00
alexey-milovidov
6fc3ca8b7b
Merge pull request #16724 from kitaisreal/added-function-accurate-cast-or-null
Added function accurateCastOrNull, allow different types inside IN subquery
2020-12-18 00:45:27 +03:00
Alexey Milovidov
f7f8ff8758 Merge branch 'master' into sigaltstack 2020-12-17 22:16:30 +03:00
Nikolai Kochetov
654b8528b2 Try fix build 2020-12-17 22:14:01 +03:00
Maksim Kita
9aaa2f9345 Fixed compilation timeout 2020-12-17 21:32:25 +03:00
Alexey Milovidov
08cc43da81 Merge branch 'master' into harmful 2020-12-17 21:08:48 +03:00
Nikolai Kochetov
171a992192 Merge branch 'master' into ucasFL-master 2020-12-17 18:52:13 +03:00
Nikita Mikhaylov
0f3582883c
Merge pull request #18147 from kitaisreal/array-aggregation-big-integer-types-support
Added array aggregation big integer types support
2020-12-17 15:44:55 +03:00
Nikita Mikhaylov
d302685e72
Merge pull request #18172 from nikitamikhaylov/julian-day-msan
toModifiedJulianDayOrNull msan fix
2020-12-17 15:12:05 +03:00
nikitamikhaylov
3e07094364 style 2020-12-17 15:11:32 +03:00
Alexey Milovidov
bef492240c Apply harmful library only for clickhouse binary 2020-12-17 06:45:46 +03:00
Alexey Milovidov
01d3aef890 Disable trap back 2020-12-17 05:53:43 +03:00
nikitamikhaylov
22363f6086 better 2020-12-17 05:29:27 +03:00
nikitamikhaylov
db362e4585 done 2020-12-17 05:27:32 +03:00
Alexey Milovidov
4e8978e022 Merge with master 2020-12-17 05:21:27 +03:00
Alexey Milovidov
7f280bef37 Merge branch 'master' into sigaltstack 2020-12-17 05:09:10 +03:00
Alexander Tokmakov
6c8f844442 better exception message for unknown function 2020-12-17 00:42:14 +03:00
Maksim Kita
8f49946a72 Reused Result type 2020-12-17 00:21:44 +03:00
Maksim Kita
4b32bb323a Fixed style issues 2020-12-17 00:04:03 +03:00
Maksim Kita
5a096a75b8 Fixed issues with average 2020-12-16 23:10:40 +03:00
Maksim Kita
b82770c2ad Added array aggregation big integer types support 2020-12-16 18:47:30 +03:00
Anton Popov
b485b5bd1c minor fixes and comments added 2020-12-16 01:22:21 +03:00
Maksim Kita
4e3cc606e6 Fixed tests 2020-12-15 23:36:45 +03:00
Maksim Kita
51f53ce8e9 Added tryParseDecimal functions 2020-12-15 21:54:16 +03:00
Anton Popov
dd09e1d783 fix type map ser/de to json 2020-12-15 17:34:37 +03:00
Anton Popov
c78861e86e Merge remote-tracking branch 'upstream/master' into HEAD 2020-12-15 01:45:01 +03:00
Anton Popov
afc2d7099b add conversion from array to map 2020-12-15 01:16:04 +03:00
Maksim Kita
17b43ca721 Fixed tests 2020-12-14 22:12:15 +03:00
Maksim Kita
16a30eb4aa Updated non-finite floating conversion into int 2020-12-14 22:12:15 +03:00
Maksim Kita
0b565b679e Fixed Set execute for columns that cannot be inside Nullable 2020-12-14 22:12:15 +03:00
Maksim Kita
18dc118298 Fixed compile issues 2020-12-14 22:12:15 +03:00
Maksim Kita
0464859cfe Updated usage of different types during IN query
1. Added accurateCast function.
2. Use accurateCast in Set during execute.
3. Added accurateCast tests.
4. Updated select_in_different_types tests.
2020-12-14 22:12:15 +03:00
Maksim Kita
f4b8e8ef99 Allow different types inside IN subquery 2020-12-14 22:12:15 +03:00
Maksim Kita
dff31e8de7 Fixed compile issues 2020-12-14 22:12:15 +03:00
Maksim Kita
0dac432942 Added const to arguments 2020-12-14 22:12:15 +03:00
Maksim Kita
dd072a20c9 Fixed compile issues 2020-12-14 22:12:15 +03:00
Maksim Kita
4435642e39 Fixed style issues 2020-12-14 22:12:15 +03:00
Maksim Kita
db5d0944ed Added Decimal support 2020-12-14 22:12:15 +03:00
Maksim Kita
baad78d2f2 Fixed setting null value in vector. Updated tests. 2020-12-14 22:12:15 +03:00
Maksim Kita
4cd5025e83 Added numeric limits for UInt128 2020-12-14 22:12:15 +03:00
Maksim Kita
d636e1618b Added function accurate cast or null 2020-12-14 22:12:15 +03:00
alexey-milovidov
ab17927c85
Merge pull request #18032 from kitaisreal/array-aggregation-functions
Array aggregation functions
2020-12-14 14:11:09 +03:00
alexey-milovidov
8a20d449d9
Update arrayAggregation.cpp 2020-12-14 14:01:31 +03:00
Maksim Kita
0be51cbabd Updated tests 2020-12-13 21:27:48 +03:00
alexey-milovidov
d8484d9c31
Merge pull request #18033 from ClickHouse/encode-xml-rename-files
encodeXMLComponent: rename files after #17659
2020-12-13 18:28:52 +03:00
Maksim Kita
5d6036e9c8 Fixed style issues 2020-12-13 14:38:56 +03:00
alexey-milovidov
04e222f6f3
Merge pull request #17986 from azat/fwd-decl
More forward declaration for generic headers
2020-12-13 01:12:05 +03:00
Maksim Kita
b810b28b08 Added comment 2020-12-13 00:40:34 +03:00
Maksim Kita
0dcbcec19a Added tests 2020-12-13 00:29:09 +03:00
Alexey Milovidov
532557ecfd encodeXMLComponent: rename files after #17659 2020-12-12 23:47:37 +03:00
Maksim Kita
18bde6ef02 Fixed compile issues 2020-12-12 23:47:23 +03:00
alexey-milovidov
2eabd41749
Merge pull request #17659 from nautaa/master
add function to escape charaters for XML
2020-12-12 23:43:41 +03:00
Maksim Kita
3d261c82e9 Array aggregation functions 2020-12-12 22:50:28 +03:00
Azat Khuzhin
5b3ab48861 More forward declaration for generic headers
The following headers are pretty generic, so use forward declaration as
much as possible:
- Context.h
- Settings.h
- ConnectionTimeouts.h
(Also this shows that some missing some includes -- this has been fixed)

And split ConnectionTimeouts.h into ConnectionTimeoutsContext.h (since
module part cannot be added for it, due to recursive build dependencies
that will be introduced)

Also remove Settings from the RemoteBlockInputStream/RemoteQueryExecutor
and just pass the context, since settings was passed only in speicifc
places, that can allow making a copy of Context (i.e. Copier).

Approx results (How much units will be recompiled after changing file X?):

- ConnectionTimeouts.h
  - mainline: 100

- Context.h:
  - mainline: ~800
  - patched:  415

- Settings.h:
  - mainline: 900-1K
  - patched:  440 (most of them because of the Context.h)
2020-12-12 17:43:10 +03:00
alexey-milovidov
e00b99ffe9
Update encodeXML.cpp 2020-12-12 03:09:11 +03:00
alexey-milovidov
b96316f0c4
Update encodeXML.cpp 2020-12-12 03:06:09 +03:00
alexey-milovidov
93985e6645
Update encodeXML.cpp 2020-12-12 03:05:35 +03:00
Alexander Kuzmenkov
fb1221148d
Merge pull request #17748 from azat/custom-TLD
Add ability to use custom TLD list
2020-12-11 12:42:19 +03:00
nauta
00dc104025 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse 2020-12-11 16:15:40 +08:00
alexey-milovidov
2fb7ce8340
Revert "Date vs DateTime64 comparison" 2020-12-11 01:09:01 +03:00
Nikita Mikhaylov
80d4af9a73
Merge pull request #17874 from nikitamikhaylov/calendar-date
Merging #17750
2020-12-10 00:19:04 +03:00
Azat Khuzhin
916cbd6610 Add ability to use custom TLD list
v2: Add a note that top_level_domains_lists aren not applied w/o restart
v3: Remove ExtractFirstSignificantSubdomain{Default,Custom}Lookup.h headers
v4: TLDListsHolder: remove FIXME for dense_hash_map (this is not significant)
2020-12-09 21:08:22 +03:00
nikitamikhaylov
b13873356c also style 2020-12-09 18:30:44 +03:00
Nikolai Kochetov
6a9e1ce436
Merge pull request #17895 from Enmk/DateTime64_DateTime_comparison
Date vs DateTime64 comparison
2020-12-09 14:22:26 +03:00
nauta
15eb2addd1 fix encodeXML 2020-12-09 16:55:03 +08:00
nauta
12f1ebdc00 fix encodeXML 2020-12-09 15:08:12 +08:00
nauta
c05ca054c1 fix encodeXML 2020-12-09 12:40:11 +08:00
nikitamikhaylov
95ce4bc54c style 2020-12-08 21:28:18 +03:00
nikitamikhaylov
e3a9cae4c5 better 2020-12-08 20:43:43 +03:00
nikitamikhaylov
71e9a8d9d0 build 2020-12-08 18:40:32 +03:00
Vasily Nemkov
0c2d73adcb Fixed comparing Date and DateTime64 2020-12-08 17:17:02 +03:00
nauta
ab5f397022 add encodeXMLComponent function 2020-12-08 21:02:09 +08:00
nikitamikhaylov
a8616ea262 better 2020-12-07 18:47:57 +03:00
PHO
3c90065158 Add functions toMJD and fromMJD
These functions convert between Proleptic Gregorian calendar date and Modified Julian Day number.
2020-12-07 16:00:32 +03:00
Alexey Milovidov
c40d024915 Merge branch 'master' into vdimir-speedup-apply-cidr-mask-v6 2020-12-07 02:20:57 +03:00
Alexey Milovidov
a63d4f0db3 Merge branch 'master' into amosbird-buildid 2020-12-07 02:17:29 +03:00
alexey-milovidov
7df72c79f1
Merge pull request #17606 from ClickHouse/boringssl-2
Port ClickHouse code to BoringSSL
2020-12-06 23:00:22 +03:00
Anton Popov
7aaa2c052f
Merge branch 'master' into merging-map 2020-12-05 22:41:46 +03:00
Anton Popov
6b09669d66 data type map: several fixes 2020-12-05 22:36:09 +03:00
Alexander Kuzmenkov
b54d50fa7f
Merge pull request #17459 from azat/countMatches-pull
Add countMatches function
2020-12-05 00:01:47 +03:00
alesapin
ac118feef0 Merge branch 'master' into boringssl-2 2020-12-04 16:24:20 +03:00
Ivan
315ff4f0d9
ANTLR4 Grammar for ClickHouse and new parser (#11298) 2020-12-04 05:15:44 +03:00
Azat Khuzhin
737357418f Fix and optimize countMatches()/countMatchesCaseInsensitive()
- Update after IFunction interfaces changes
- move type checks into FunctionCountMatches::getReturnTypeImpl()
- Use StringRef over String
- Separate out logic for counting sub matches into separate helper
- Do not copy other regular expression matches, only the first
- Add some comments
- Set is_no_capture, to avoid check for number of subpatterns
- Add countMatchesCaseInsensitive()
- Reguster functions in case-sensitive manner, since this is not SQL
  standard
2020-12-01 22:25:26 +03:00
Azat Khuzhin
0004fd8ab9 Merge remote-tracking branch 'upstream/pr/16277' into countMatches-pull 2020-12-01 21:03:33 +03:00
Anton Popov
12604ce0e6 Merge branch 'dev_map2' of git://github.com/hexiaoting/ClickHouse into merging-map 2020-12-01 14:52:30 +03:00
Amos Bird
310918b06a
reload symbols and fix build-id 2020-11-30 22:30:55 +08:00
Anton Popov
115574163e
Merge pull request #16937 from satanson/master
A very fast O(logn) repeat impl
2020-11-30 15:14:51 +03:00
Alexey Milovidov
e42ff1ae02 Port ClickHouse code to BoringSSL 2020-11-30 10:01:55 +03:00
vdimir
cd8e7981e0
Speedup applyCIDRMask for IPv6 with compile-time generated mask array 2020-11-29 20:54:46 +03:00
alexey-milovidov
51f159201b
Merge pull request #17536 from azat/fix-toUnixTimestamp-Date-error
Fix toUnixTimestamp(Date()) error (use type name not column type name)
2020-11-29 18:19:55 +03:00
Azat Khuzhin
ee38cce1bf Fix toUnixTimestamp(Date()) error (use type name not column type name)
Was:
    Code: 44. DB::Exception: Received from localhost:9000. DB::Exception: Illegal column UInt16 of first argument of function toUnixTimestamp: While processing toUnixTimestamp(today()).

Now:
    Code: 44. DB::Exception: Received from localhost:9000. DB::Exception: Illegal type Date of first argument of function toUnixTimestamp: While processing toUnixTimestamp(today()).
2020-11-28 15:05:48 +03:00
Azat Khuzhin
838596c7a4 Implement countSubstrings()
Function to count number of substring occurrences in the string:
- in case of needle is multi char - counts non-intersecting substrings
- the code is based on position helpers.

The following new functions is available:
- countSubstrings()
- countSubstringsCaseInsensitive()
- countSubstringsCaseInsensitiveUTF8()

v0: substringCount()

v2:
- add substringCountCaseInsensitiveUTF8
- improve tests
- fix coding style issues
- fix multichar needle

v3: rename to countSubstrings (by analogy with countEqual())
2020-11-26 22:58:16 +03:00
Nikolai Kochetov
9291bbb04b
Merge pull request #16804 from vdimir/ip-dict-no-trie
sorted-array based ip_dict
2020-11-26 19:26:06 +03:00
hexiaoting
5b3a7f5c98 Merge remote-tracking branch 'origin/master' into dev_map2 2020-11-26 16:43:27 +08:00
alexey-milovidov
ee3a0b790b
Merge pull request #17376 from azat/toUnixTimestamp-Date-fix
Prohibit toUnixTimestamp(Date())
2020-11-26 10:50:00 +03:00
hexiaoting
74d875c837 Merge remote-tracking branch 'origin/master' into dev_map2 2020-11-26 15:13:52 +08:00
alexey-milovidov
747453b008
Merge pull request #17051 from hexiaoting/bugfix_fuzzbits
Bug fix for funciton fuzzBits
2020-11-26 06:41:20 +03:00
Nikolai Kochetov
729272391f
Merge branch 'master' into ip-dict-no-trie 2020-11-25 23:07:19 +03:00
Azat Khuzhin
17f6c82ffa Prohibit toUnixTimestamp(Date())
Making it implicitly cast to Date() does not looks correct, since before
it returns somewhat unexpected result:

    SELECT toUnixTimestamp(today())

    ┌─toUnixTimestamp(today())─┐
    │                    18591 │
    └──────────────────────────┘
2020-11-25 00:26:14 +03:00
Nikita Mikhaylov
c25558ad2e
Revert "Attempt to fix Stress test (MSan)" 2020-11-24 20:36:17 +03:00
Anton Popov
8c5971873e Merge branch 'master' of git://github.com/satanson/ClickHouse into repeat-logn 2020-11-24 17:17:30 +03:00
Nikita Mikhaylov
44e4a4f388
Merge pull request #17344 from nikitamikhaylov/msan-fix-attempt
Attempt to fix Stress test (MSan)
2020-11-24 17:07:54 +03:00
nikitamikhaylov
9cc81dae85 done 2020-11-23 23:02:24 +03:00
alexey-milovidov
1663b13215
Merge pull request #17257 from ucasFL/fix
fix toUInt256 stack overflow
2020-11-21 22:54:06 +03:00
vdimir
a277a5bb16
Rename TrieDictionary -> IPAddressDictionary 2020-11-21 21:38:10 +03:00
fenglv
268b15f221 fix toUInt256 stack overflow 2020-11-21 12:59:40 +00:00
Nikolai Kochetov
cf678b6092 Merge branch 'master' into order-inputs-in-action-dag 2020-11-21 13:54:50 +03:00
Nikolai Kochetov
bac1def5f9
Merge pull request #17134 from abyss7/tcp-port
Implement tcpPort() function for tests
2020-11-20 20:32:55 +03:00
Alexander Kuzmenkov
bde805cb3e
Merge pull request #17175 from ClickHouse/aku/named-tuple
Allow formatting named tuples as JSON objects
2020-11-20 12:48:24 +03:00
Kruglov Pavel
51bcd286f2
Merge pull request #16845 from azat/cutToFirstSignificantSubdomainWithWWW
Add cutToFirstSignificantSubdomainWithWWW()
2020-11-20 01:44:57 +03:00
Alexander Kuzmenkov
24293ccb30 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-19 15:28:37 +03:00
Ivan
b711331e2c
Update visibleWidth.cpp 2020-11-19 10:14:23 +03:00
alexey-milovidov
c7e88087cd
Merge pull request #16636 from hombit/cmath
Add some of missed cmath functions
2020-11-19 07:37:27 +03:00
Ivan
f1650291d8
Fix gcc-10 build 2020-11-18 23:05:53 +03:00
Azat Khuzhin
48645eae33 Add cutToFirstSignificantSubdomainWithWWW()
Sometimes it is odd to get TLD itself from the
cutToFirstSignificantSubdomain() (since you will not get TLD itself if
you pass it directly):
- cutToFirstSignificantSubdomain('org')            -> ""
- cutToFirstSignificantSubdomain('www.org')        -> org
- cutToFirstSignificantSubdomain('kernel.org')     -> kernel.org
- cutToFirstSignificantSubdomain('www.kernel.org') -> kernel.org

So add one more function to get www.org in this case:
- cutToFirstSignificantSubdomainWithWWW('org')            -> ""
- cutToFirstSignificantSubdomainWithWWW('www.org')        -> www.org
- cutToFirstSignificantSubdomainWithWWW('kernel.org')     -> kernel.org
- cutToFirstSignificantSubdomainWithWWW('www.kernel.org') -> kernel.org

P.S. not sure about the naming though, so it will great if someone has
suggestion for the name.
2020-11-18 21:09:27 +03:00
Ivan Lezhankin
f7041c1b55 Fix style and ya.make 2020-11-18 16:24:16 +03:00
Ivan Lezhankin
fdd1c182ab Merge remote-tracking branch 'upstream/master' into tcp-port 2020-11-18 16:22:00 +03:00
Alexander Kuzmenkov
f2b3f5f8b6 Allow formatting named tuples as JSON objects 2020-11-18 13:38:30 +03:00
Nikolai Kochetov
266596783a Remove Converting transform and step. 2020-11-18 12:45:46 +03:00
Nikolai Kochetov
947a29e378 Remove Converting transform and step. 2020-11-18 12:38:03 +03:00
Nikolai Kochetov
354620b5a1 Remove Converting transform and step. 2020-11-18 12:35:32 +03:00
Nikolai Kochetov
76346c0563 Remove Converting transform and step. 2020-11-17 22:43:26 +03:00
Ivan
ed2452fbff
Fix build 2020-11-17 18:32:40 +03:00
Ivan Lezhankin
f897f7c93f Refactor IFunction to execute with const arguments 2020-11-17 16:24:45 +03:00
Nikolai Kochetov
013c582abf
Merge pull request #17095 from ClickHouse/actions-dag-addition
Move ActionsDAG into separate file
2020-11-17 11:17:55 +03:00
Alexey Milovidov
24f4fa6edf Follow Arcadia ya.make rules 2020-11-17 00:16:50 +03:00
Alexey Milovidov
3df04ce0c2 Follow Arcadia ya.make rules 2020-11-16 21:24:58 +03:00
Nikolai Kochetov
82e8e74bcd Fix includes. 2020-11-16 18:39:12 +03:00
hexiaoting
26a529fc32 Bug fix for funciton fuzzBits 2020-11-16 11:46:05 +08:00
satanson
39fa688420 use 1ULL instead of 1 in shift operation 2020-11-14 22:33:08 +08:00
Ivan Lezhankin
bef6463cb4 Implement tcpPort() function 2020-11-13 18:50:50 +03:00
satanson
3dd4f2fb1e use unlikely instead of BOOST_UNLIKELY 2020-11-13 15:21:08 +08:00
satanson
766883a0e3 A very fast O(logn) repeat impl 2020-11-13 00:47:59 +08:00
Nikolai Kochetov
46f70dd0de Merge branch 'master' into actions-dag-f14 2020-11-12 11:54:44 +03:00
Alexander Tokmakov
b94cc5c4e5 remove more stringstreams 2020-11-10 21:22:26 +03:00
Nikolai Kochetov
1db8e77371 Add comments. Update ActionsDAG::Index 2020-11-10 17:54:59 +03:00
Nikolai Kochetov
6717c7a0af Merge branch 'master' into actions-dag-f14 2020-11-09 14:57:48 +03:00
alexey-milovidov
2d427eb1e8
Merge pull request #16496 from ClickHouse/register-formats
Fix inconsistency in FormatFactory
2020-11-08 14:27:33 +03:00
Alexey Milovidov
d564e4efad Fix build 2020-11-07 03:29:49 +03:00
Alexey Milovidov
fd84d16387 Fix "server failed to start" error 2020-11-07 03:14:53 +03:00
Nikolai Kochetov
93e4802fa4 Try fix integration test. 2020-11-06 17:07:28 +03:00
Nikolai Kochetov
9aeb757da4 Merge branch 'master' into actions-dag-f14 2020-11-06 15:04:20 +03:00
hexiaoting
ef0b78cf12 style error fix 2020-11-06 17:21:26 +08:00
Nikolai Kochetov
983aaa3b83 Try fix integration test. 2020-11-06 11:08:47 +03:00
hexiaoting
28e87da976 remove map literal and Merge remote-tracking branch 'origin/master' into dev_map2 2020-11-06 15:07:41 +08:00
alexey-milovidov
7bda6dba3c
Merge pull request #16657 from ucasFL/reinterpret
Allow reinterpret between integers and floats of the same size
2020-11-05 23:21:59 +03:00
alexey-milovidov
39cd1c0371
Merge pull request #16700 from ClickHouse/better-arcadia
Improve Arcadia
2020-11-05 15:34:34 +03:00
alexey-milovidov
5954b7ec8b
Merge pull request #16570 from JacobHayes/add-farmfingerprint64
Add farmFingerprint64 function
2020-11-05 13:36:59 +03:00
Alexey Milovidov
b56486510f Improve Arcadia 2020-11-05 12:55:01 +03:00