Commit Graph

760 Commits

Author SHA1 Message Date
Maksim Kita
318c4bb80d Add examples folder filter to ya.make.in 2021-04-30 11:25:52 +03:00
Nikita Mikhaylov
9f55424250 move to examples everywhere 2021-04-27 01:51:42 +03:00
Alexey Milovidov
4ff812db7f Maybe better support for paths with whitespaces 2021-04-24 22:47:52 +03:00
Kseniia Sumarokova
b43656bf89
Merge pull request #22697 from TCeason/feature/add_MaterializeMySQL_sync_bytes_judgment
Add MySQL read history data bytes judgment
2021-04-20 10:26:42 +03:00
TCeason
472c131420 Add MySQL read history data bytes judgment 2021-04-19 10:51:50 +08:00
Maksim Kita
b26dfcd514 Simple key dictionary primary key wrong order fix 2021-04-18 15:19:44 +03:00
kssenii
5dc2dfa437 Fix 2021-04-17 09:00:58 +00:00
Maksim Kita
d381e59791
Merge pull request #23114 from kitaisreal/fix-arcadia-build-s3
Fix arcadia build S3
2021-04-16 23:35:10 +03:00
Maksim Kita
1797a67cf8
Merge pull request #22925 from kitaisreal/flat_dictionary_performance_test_fix
Dictionaries updated performance tests
2021-04-16 10:46:41 +03:00
Maksim Kita
eceed68d62 Fix arcadia build S3 2021-04-15 12:31:09 +03:00
Maksim Kita
2c3abcaad1 Updated test 2021-04-14 16:49:38 +03:00
Maksim Kita
4425bec599
Merge pull request #22764 from kitaisreal/connection-pool
Moved BorrowedObjectPool to common
2021-04-14 11:23:56 +03:00
Maksim Kita
dcf41db1ae
Merge pull request #23048 from kitaisreal/library-dictionary-bridge-library-interface
LibraryDictionary bridge library interface
2021-04-14 11:23:29 +03:00
Maksim Kita
0cfe018fd4 Moved BorrowedObjectPool to common 2021-04-13 23:15:22 +03:00
Maksim Kita
616d7d19f8 LibraryDictionary bridge library interface 2021-04-13 22:53:36 +03:00
Maksim Kita
20d5d550c4
Merge pull request #22960 from kitaisreal/dictionary-added-decimal256-attribute-type-support
Dictionary added Decimal256 attribute type support
2021-04-11 13:07:00 +03:00
Maksim Kita
8dbf721e52
Merge pull request #22961 from kitaisreal/dictionaries-standardize-exceptions
Dictionaries standardize exceptions
2021-04-11 12:05:59 +03:00
Ivan
495c6e03aa
Replace all Context references with std::weak_ptr (#22297)
* Replace all Context references with std::weak_ptr

* Fix shared context captured by value

* Fix build

* Fix Context with named sessions

* Fix copy context

* Fix gcc build

* Merge with master and fix build

* Fix gcc-9 build
2021-04-11 02:33:54 +03:00
Maksim Kita
b43a709fec Dictionaries standardize exceptions 2021-04-10 21:48:36 +03:00
Maksim Kita
7df43891c1 Dictionary added Decimal256 attribute type support 2021-04-10 19:53:21 +03:00
Azat Khuzhin
93c9a02480 Fix bytes_allocated for sparse_hashed dictionaries 2021-04-08 23:29:29 +03:00
alexey-milovidov
ed367855d5
Merge pull request #22822 from kitaisreal/file-dictionary-source-fix-absolute-path
FileDictionarySource fix absolute file path
2021-04-08 10:34:07 +03:00
Maksim Kita
ef7571c226
Merge pull request #22521 from kitaisreal/dictionaries-update-field-fix
FlatDictionary, HashedDictionary update_field optimizations
2021-04-07 23:29:53 +03:00
Maksim Kita
ff04292ac8
Update FileDictionarySource.cpp 2021-04-07 21:42:09 +03:00
Maksim Kita
f7cc15fdcd FileDictionarySource fix absolute file path 2021-04-07 21:38:24 +03:00
Maksim Kita
7baafcb567
Merge pull request #22630 from kitaisreal/direct-dictionary-dict-get-multiple-columns-optimization
DirectDictionary dictGet multiple columns optimization
2021-04-07 10:29:42 +03:00
alesapin
86a843bb51
Merge pull request #21509 from kssenii/library-bridge
clickhouse-library-bridge for library dictionary source
2021-04-06 12:26:08 +03:00
kssenii
dc42d5189d Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-04-05 15:36:35 +00:00
kssenii
9dba529494 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-04-05 13:14:51 +00:00
Maksim Kita
d9cc03bc34 Fixed tests 2021-04-05 11:29:05 +03:00
Maksim Kita
deb35c5f4e DirectDictionary dictGet multiple columns optimization 2021-04-05 01:26:26 +03:00
alexey-milovidov
b1e7624b3f
Merge pull request #22589 from ClickHouse/fix-comments
Fix comments
2021-04-05 00:22:27 +03:00
Maksim Kita
027ca2484e FlatDictionary added layout options initial_array_size, max_array_size 2021-04-04 16:30:48 +03:00
Maksim Kita
41ef9291f1 Fixed tests 2021-04-04 16:30:48 +03:00
Maksim Kita
ff86c21e65 Dictionary update field fix 2021-04-04 16:30:48 +03:00
Maksim Kita
0bfb429c42
Merge pull request #22479 from kitaisreal/clickhouse-dictionary-source-loop-fix
ClickHouseDictionarySource loop fix
2021-04-04 13:29:17 +03:00
Alexey Milovidov
54caa61af5 Fix comments 2021-04-04 12:33:06 +03:00
Maksim Kita
b9e8ff137a Fixed build 2021-04-04 01:19:57 +03:00
Denis Glazachev
36b03b2740 Compilation fix 2021-04-03 22:17:51 +04:00
kssenii
13d1f17d3e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-04-03 08:00:09 +00:00
Maksim Kita
07d5a1ec21 ClickHouseDictionarySource loop fix 2021-04-03 00:40:07 +03:00
kssenii
2de6b99f84 Better names 2021-04-02 16:12:14 +00:00
kssenii
99f0b08ac3 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-04-01 13:48:33 +00:00
Maksim Kita
42ae39f78f Updated tests 2021-04-01 12:13:36 +03:00
Maksim Kita
2ad29a541a Updated interfaces 2021-04-01 00:12:21 +03:00
Maksim Kita
55984e849c
Merge branch 'master' into hierarchy-dictionaries-updated 2021-03-31 15:55:07 +03:00
Maksim Kita
9772d30754 Fixed performance tests 2021-03-31 13:21:30 +03:00
alexey-milovidov
d7c15c6b9a
Merge pull request #22289 from traceon/fix-apple-clang-build
Fix native macOS build for ALL_BUILD (Xcode/AppleClang)
2021-03-30 23:55:13 +03:00
kssenii
ce05087b1b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-03-30 17:27:10 +00:00
Vladimir
5ae9f2c5bb
Merge pull request #21329 from depressed-pho/isIPAddressContainedIn 2021-03-30 13:26:49 +03:00
alexey-milovidov
4e4d33e93b
Merge branch 'master' into fix-apple-clang-build 2021-03-30 13:15:07 +03:00
Maksim Kita
8a65e8b06e Fix arcadia build 2021-03-29 23:00:40 +03:00
Maksim Kita
3071d45ade Fixed tests 2021-03-29 16:41:03 +03:00
Anton Popov
ea82e7725f
Merge pull request #21562 from CurtizJ/serialization-refactoring-4
Refactoring of data types serialization
2021-03-29 16:36:44 +03:00
Denis Glazachev
7fd7a7114f Remove unused local variable definition 2021-03-29 14:47:56 +04:00
vdimir
24aa25d7dc
Reuse some functions for IPAddressContainedIn 2021-03-29 12:04:05 +03:00
kssenii
22b515fbc9 Add namespace, simplify names 2021-03-27 20:14:02 +00:00
kssenii
f40c582e7a Replicas/shards for postgres storage 2021-03-27 20:11:48 +00:00
kssenii
95e8a8b9f0 Support shards 2021-03-27 14:40:07 +00:00
kssenii
ae868208c2 Use pool with failover in mysql storage 2021-03-27 14:39:45 +00:00
Maksim Kita
4f298d54b9 Added perf tests 2021-03-27 17:00:00 +03:00
Maksim Kita
ca6146b040 Fixed build 2021-03-27 13:42:46 +03:00
Maksim Kita
0faab7ae35 Fixed PODArray insertFromItself 2021-03-27 00:49:16 +03:00
Maksim Kita
3f273ef983 Updated hash dictionary nullable attribute implementation 2021-03-26 21:01:56 +03:00
Maksim Kita
5fd575977a Fixed typos 2021-03-26 18:42:32 +03:00
Maksim Kita
2cac8d13cc Updated tests and documentation 2021-03-26 18:42:32 +03:00
Maksim Kita
13417b5b40 Added documentation 2021-03-26 18:42:32 +03:00
Maksim Kita
eb0039ed03 Fixed tests 2021-03-26 18:42:32 +03:00
Maksim Kita
21d28a37aa Fixed build 2021-03-26 18:42:32 +03:00
Maksim Kita
3b10043eb2 Fix style check 2021-03-26 18:42:32 +03:00
Maksim Kita
720e2e0501 Updated dictGetDescendants, dictGetChildren implementation 2021-03-26 18:42:32 +03:00
Maksim Kita
566541528d Update function naming 2021-03-26 18:42:32 +03:00
Maksim Kita
bbd180caf3 Added functions dictGetChildren, dictGetDescendants 2021-03-26 18:42:32 +03:00
Maksim Kita
9f2f0d1095 Refactored hierarchy dictionaries interface 2021-03-26 18:42:32 +03:00
PHO
1868ca34b8 Fix build on GCC where std::isinf() cannot be called without the namespace prefix 2021-03-26 12:11:22 +09:00
Maksim Kita
bbe1960eea
Merge pull request #21573 from kitaisreal/updated-cache-dictionary-storage
Added specialized CacheDictionaryStorage
2021-03-25 21:29:01 +03:00
Anton Popov
6a15431be7 Merge remote-tracking branch 'upstream/master' into HEAD 2021-03-25 15:57:35 +03:00
kssenii
6d41f7356b Better way to pass attributes 2021-03-24 19:32:31 +00:00
kssenii
d9326cc229 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-24 18:28:55 +00:00
kssenii
7da36be9b6 Better 2021-03-24 09:23:29 +00:00
kssenii
c008f054ae Pass sample_block only once 2021-03-24 08:41:42 +00:00
kssenii
1ef3c1f780 Use binary format for params 2021-03-24 07:55:21 +00:00
kssenii
b8d9b97903 Better 2021-03-23 15:43:14 +00:00
Maksim Kita
bde02c72f3 Fixed typos 2021-03-23 18:14:22 +03:00
Maksim Kita
890bd6f1e9 Fixed code review issues 2021-03-23 15:14:37 +03:00
Alexander Kuzmenkov
d40f781b9a Merge origin/master into tmp (using imerge) 2021-03-22 23:27:18 +03:00
Alexander Kuzmenkov
77a2f03d3b prevent accidental reinterpret_cast in Field::get<> 2021-03-22 23:23:44 +03:00
kssenii
472ce89b75 Small fixes 2021-03-22 14:39:17 +00:00
kssenii
8a650c4408 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-22 13:38:25 +00:00
Maksim Kita
56840aba5a Fixed tests 2021-03-22 16:02:32 +03:00
Nikita Mikhaylov
330e74b665
Merge pull request #21890 from kitaisreal/polygon-dictionary-added-nullable-support
PolygonDictionary added nullable support
2021-03-22 14:49:28 +03:00
Maksim Kita
c5f918f198 CacheDictionaryStorage insert into default value fix 2021-03-21 19:26:06 +03:00
Maksim Kita
257e0455dd Fixed tests 2021-03-21 18:10:12 +03:00
Maksim Kita
249d4a1843 Fixed tests 2021-03-21 18:10:12 +03:00
Maksim Kita
df9223e13b PolygonDictionary added nullable support 2021-03-21 18:09:47 +03:00
Maksim Kita
fff110aa38 HashedDictionary clickhouse source preallocate regression fix 2021-03-21 17:52:33 +03:00
Maksim Kita
a53c90e509 Upated system.dictionaries table 2021-03-19 12:43:57 +03:00
Maksim Kita
c01171c626 Fixed tests 2021-03-18 14:58:43 +03:00
Maksim Kita
18ed9c5c67 SSDCacheDictionary remove max_stored_keys option 2021-03-18 12:55:17 +03:00
Maksim Kita
d5a1b50fd2 Updated naming 2021-03-17 22:06:46 +03:00
Maksim Kita
f140204279 Improved performance of SSDCache dictionary 2021-03-17 22:01:45 +03:00
Maksim Kita
bc22f4f6eb Updated implementation 2021-03-17 20:14:36 +03:00
kssenii
34dea63248 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-17 13:32:43 +00:00
Nikita Mikhaylov
f51b41b7a4
Merge pull request #21710 from kssenii/replica-priorities
Support replicas priority for postgres dictionary source
2021-03-17 16:02:00 +03:00
alexey-milovidov
d02726bcac
Merge pull request #9404 from Enmk/DateTime64_extended_range
Date time64 extended range
2021-03-17 11:06:03 +03:00
Anton Popov
6247cd5503 Merge remote-tracking branch 'upstream/master' into HEAD 2021-03-16 16:50:15 +03:00
Nikita Mikhaylov
7d7a2bc724
Merge pull request #21630 from nikitamikhaylov/pf-local
Parallel formatting for clickhouse-local
2021-03-16 14:37:40 +03:00
Anton Popov
173d2ea1f4 Merge remote-tracking branch 'upstream/master' into HEAD 2021-03-16 02:50:14 +03:00
Maksim Kita
3d1c42827b Added FixedDeadlineHashMap 2021-03-16 01:59:04 +03:00
Alexey Milovidov
3f67f4f47b Saturation for DateTime 2021-03-15 23:40:33 +03:00
Alexey Milovidov
671395e8c8 Most likely improve performance 2021-03-15 22:23:27 +03:00
Alexey Milovidov
eaeb4a3bf0 Merge branch 'master' into DateTime64_extended_range 2021-03-15 16:59:32 +03:00
Nikita Mikhaylov
1f92c8ce58 parallel formatting everywhere 2021-03-15 14:51:24 +03:00
kssenii
19de1ec457 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-15 06:54:02 +00:00
alexey-milovidov
afa24938bc
Merge pull request #21686 from kitaisreal/library-dictionary-source-fix-possible-leak
LibraryDictionarySource fix possible leak
2021-03-15 00:06:15 +03:00
kssenii
8688ae9346 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-14 19:32:21 +00:00
Maksim Kita
ee898d6d47 Fixed style check 2021-03-14 15:51:55 +03:00
Maksim Kita
0783882fcf Updated cache implementation 2021-03-14 14:33:21 +03:00
Maksim Kita
ce20eae2a3 Added specialized CacheDictionaryStorage 2021-03-14 14:33:21 +03:00
Maksim Kita
1ac62970c4 Modified SharedLibrary interface 2021-03-14 14:29:02 +03:00
Maksim Kita
40d2ec7924
Merge pull request #19816 from kitaisreal/range-hashed-dictionary-support-has-keys
RangeHashed dictionary support dictHas function
2021-03-14 13:44:06 +03:00
alexey-milovidov
53e21443eb
Merge branch 'master' into DateTime64_extended_range 2021-03-14 12:27:17 +03:00
kssenii
8eea6a87e9 Support replicas priority for postgres dictionary source 2021-03-14 08:51:24 +00:00
Maksim Kita
084bd03672
Merge pull request #21692 from azat/dict-ip_trie-access_to_key_from_attributes
Fix SIGSEGV on not existing attributes from ip_trie with access_to_key_from_attributes
2021-03-13 23:13:26 +03:00
Anton Popov
81ac6382a3 slightly better performance 2021-03-13 21:05:18 +03:00
Maksim Kita
ee8c51f65e Fixed tests 2021-03-13 14:58:31 +03:00
Maksim Kita
854bfaf366 RangeHashed dictionary support has function 2021-03-13 14:57:56 +03:00
Maksim Kita
6be5c271ae Added explicit function interface 2021-03-13 14:09:56 +03:00
Azat Khuzhin
0c1b2f6d59 Update exception message for lack of attribute with access_to_key_from_attributes 2021-03-13 12:53:10 +03:00
Maksim Kita
79b061ac3c
Merge pull request #21668 from kitaisreal/dictionary-attributes-unique-names
DictionaryStructure fix non unique attribute names
2021-03-13 12:31:33 +03:00
Azat Khuzhin
481d897cad Fix SIGSEGV on not existing attributes from ip_trie with access_to_key_from_attributes
Found with fuzzer [1]:

  [1]: https://clickhouse-test-reports.s3.yandex.net/21674/2e99dad56213413a72969d47650050b42cbcc073/fuzzer_asan/report.html#fail1
2021-03-13 09:08:45 +03:00
Anton Popov
ed42437219 Merge remote-tracking branch 'upstream/master' into HEAD 2021-03-13 01:41:26 +03:00
Maksim Kita
8312553d24 LibraryDictionarySource fix possible leak 2021-03-13 00:30:59 +03:00
kssenii
323fb54a8e Fix split build finally 2021-03-12 21:12:34 +00:00
Maksim Kita
8443ff563b Fixed code review issues 2021-03-12 18:22:04 +03:00
Maksim Kita
97a58777b8 DictionaryStructure fix non unique attribute names 2021-03-12 16:36:42 +03:00
Maksim Kita
1b908cad88 ExecutablePool fix default max execution time setting 2021-03-12 15:37:56 +03:00
kssenii
70f8f90511 Fix split build 2021-03-12 08:04:20 +00:00
kssenii
9e0101e5fc Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-12 07:47:22 +00:00
kssenii
e77ff68582 Better 2021-03-10 18:26:15 +00:00
kssenii
38f7f37468 Add loadKeys method 2021-03-10 13:23:07 +00:00
Maksim Kita
9509516e3c Fixed tests 2021-03-10 01:26:06 +03:00
Maksim Kita
5e03418651 Added performance tests 2021-03-09 23:50:36 +03:00
Maksim Kita
ed295a934c Fixed tests 2021-03-09 23:50:36 +03:00
Maksim Kita
f9b0fdad14 Fixed tests 2021-03-09 23:50:36 +03:00
Maksim Kita
b5f51e0ca6 Fixed style check 2021-03-09 23:50:06 +03:00
Maksim Kita
45879472d3 DirectDictionary updated 2021-03-09 23:49:34 +03:00
Maksim Kita
43ba554191
Merge pull request #20595 from kitaisreal/cache-dictionaries-lru-cache
Cache dictionaries lru cache
2021-03-09 19:14:30 +03:00
Anton Popov
bc417cf54a refactoring of serializations 2021-03-09 17:46:52 +03:00
Maksim Kita
edb673af56 Fixed tests 2021-03-09 01:03:25 +03:00