Commit Graph

24641 Commits

Author SHA1 Message Date
alexey-milovidov
2a1fb20c27
Merge pull request #8720 from ClickHouse/GrigoryPervakov-vfs-s3
Merging DiskS3
2020-01-21 02:06:41 +03:00
alexey-milovidov
c4e2d71b48
Merge pull request #8749 from ikopylov/function-bitCount-Int16-Int8-perf
bitCount performance: special handling for Int16 and Int8
2020-01-21 00:12:34 +03:00
Alexander Tokmakov
05c4405b65 fix 2020-01-20 23:08:47 +03:00
Alexey Milovidov
e4ff88a604 Added a test from Zlobober #5610 2020-01-20 22:43:57 +03:00
alexey-milovidov
9f550fc97f
Merge pull request #8744 from filimonov/test_for_incremental_filling_with_feedback
Test for incremental filling with feedback
2020-01-20 22:03:29 +03:00
Nikolai Kochetov
ccb124ebdf Update SortingTransform. 2020-01-20 19:48:15 +03:00
ikopylov
f5f36f0199
bitCount performance: special handling for Int16 and Int8 2020-01-20 19:36:03 +03:00
Alexey Milovidov
856962b290 Fixed test 2020-01-20 19:33:43 +03:00
Alexey Milovidov
24a8bfe096 Minor improvements 2020-01-20 18:57:13 +03:00
Mikhail Filimonov
bfb448b209 Test for incremental filling from 2 sources with feedback 2020-01-20 14:04:16 +01:00
Alexey Milovidov
d547c23300 Minor modification 2020-01-20 15:58:55 +03:00
Alexey Milovidov
09f3890b20 Merge branch 'master' into GrigoryPervakov-vfs-s3 2020-01-20 15:39:15 +03:00
Nikolai Kochetov
76171c7afc Do not add resize transform for SystemNumbers. 2020-01-20 10:24:28 +03:00
Nikolai Kochetov
cd369bea4e Do not add resize transform for SystemNumbers. 2020-01-19 23:05:01 +03:00
Alexey Milovidov
d159570309 Added a test for fun 2020-01-19 22:09:03 +03:00
Alexey Milovidov
40e35c36e7 Minor modifications 2020-01-19 20:02:29 +03:00
alexey-milovidov
9e1ab408f6
Merge pull request #8728 from Akazz/fixing_ternary_logic_for_batches
A followup to #8718: Simpler and faster code in logical functions
2020-01-19 16:22:30 +03:00
alexey-milovidov
c2e95c008e
Merge pull request #8724 from yurriy/less-mysql-logging
Proper logging levels in MySQL compatibility server
2020-01-19 16:19:30 +03:00
Alexey Milovidov
41263dc3f9 Merge remote-tracking branch 'origin/master' into oandrew-avro 2020-01-19 15:27:11 +03:00
Alexey Milovidov
98d393c957 Fixed LineReader 2020-01-19 15:26:49 +03:00
alexey-milovidov
9fa877341b
Merge pull request #8719 from ClickHouse/bitCount-improve-performance
Reasonable performance for function bitCount
2020-01-19 15:23:32 +03:00
Azat Khuzhin
cbebb94f25 Fix ryu_test compilation (missing <cstring> for memcpy) with libstdc++
libc++ has <cstring> in <string> while libstdc++ does not:

  $ fgrep -r '#include <cstring>' /usr/include/c++/v1/
  /usr/bin/../include/c++/v1/vector:#include <cstring>
  /usr/bin/../include/c++/v1/ext/__hash:#include <cstring>
  /usr/bin/../include/c++/v1/memory:#include <cstring>
  /usr/bin/../include/c++/v1/algorithm:#include <cstring>
  /usr/bin/../include/c++/v1/string:#include <cstring>
  /usr/bin/../include/c++/v1/utility:#include <cstring>

  $ fgrep -r '#include <cstring>' /usr/include/c++/9.2.0/
  /usr/include/c++/9.2.0/experimental/buffer:#include <cstring>
  /usr/include/c++/9.2.0/regex:#include <cstring>
  /usr/include/c++/9.2.0/x86_64-pc-linux-gnu/bits/stdc++.h:#include <cstring>
  /usr/include/c++/9.2.0/x86_64-pc-linux-gnu/32/bits/stdc++.h:#include <cstring>

  $ clang++ -stdlib=libc++ -o /dev/null -c /tmp/test.cpp
  /tmp/test.cpp:7:30: warning: null passed to a callee that requires a non-null argument [-Wnonnull]
          return memcpy(0, 0, 0);
                        ~      ^
  /tmp/test.cpp:7:30: warning: null passed to a callee that requires a non-null argument [-Wnonnull]
          return memcpy(0, 0, 0);
                           ~   ^
  2 warnings generated.

  $ clang++ -o /dev/null -c /tmp/test.cpp
  /tmp/test.cpp:7:16: error: use of undeclared identifier 'memcpy'; did you mean 'wmemcpy'?
          return memcpy(0, 0, 0);
                 ^~~~~~
                 wmemcpy
  /usr/include/wchar.h:262:17: note: 'wmemcpy' declared here
  extern wchar_t *wmemcpy (wchar_t *__restrict __s1,
                  ^
  1 error generated.
2020-01-19 14:14:41 +03:00
Nikolai Kochetov
4523f9b2f9
Update ResizeProcessor.cpp
remove comment
2020-01-19 10:11:21 +03:00
Alexander Kazakov
bffd66fcba More effective code + some cleanup 2020-01-19 09:22:01 +03:00
Alexander Kazakov
3b6499cce9 Made code in OperationApplier more generic 2020-01-19 09:07:30 +03:00
alexey-milovidov
c711ce500b
Merge pull request #8422 from excitoon-favorites/bettertestalterttl
Fixed `ALTER MODIFY TTL`
2020-01-19 04:53:11 +03:00
alexey-milovidov
36a7a40a08
Merge pull request #8718 from Akazz/fixing_ternary_logic_for_batches
Fixed ternary logic (OR/AND/XOR) calculation in multiple batches
2020-01-19 04:49:04 +03:00
Alexey Milovidov
b5ff5341d5 Support more types for output 2020-01-19 04:22:27 +03:00
Yuriy
6f4431b79f proper logging levels 2020-01-19 01:19:06 +00:00
Alexey Milovidov
4fdfb02b2f Fixed build 2020-01-19 03:43:59 +03:00
alexey-milovidov
901009d9b0
Merge branch 'master' into oandrew-avro 2020-01-19 03:37:29 +03:00
Alexey Milovidov
db1bb630e0 Fixed configuration of replxx 2020-01-19 03:23:35 +03:00
Alexey Milovidov
47f6156ad8 Correct configuration of replxx 2020-01-19 03:01:49 +03:00
Alexey Milovidov
6eef7de47f Removed questionable code 2020-01-19 02:42:46 +03:00
Alexey Milovidov
2d39e5ad8c Merging DiskS3 2020-01-19 02:18:23 +03:00
Alexey Milovidov
4da00994d1 Merging DiskS3 2020-01-19 01:17:48 +03:00
Alexey Milovidov
ae7b9a652b Merge branch 'vfs-s3' of https://github.com/GrigoryPervakov/ClickHouse into GrigoryPervakov-vfs-s3 2020-01-19 01:12:05 +03:00
alexey-milovidov
530e7e381a
Update DiskMemory.cpp 2020-01-19 01:07:03 +03:00
alexey-milovidov
feabcf53cb
Update DiskMemory.cpp 2020-01-19 01:05:37 +03:00
alexey-milovidov
7583f8744a
Merge branch 'master' into bettertestalterttl 2020-01-19 01:03:25 +03:00
Alexey Milovidov
28ad3b46da Reasonable performance for function bitCount 2020-01-19 00:59:07 +03:00
Alexey Milovidov
ae185a24d2 Disable AvroConfluent 2020-01-19 00:45:16 +03:00
Alexey Milovidov
d732f854b7 Added timeouts for schema request 2020-01-19 00:42:51 +03:00
alexey-milovidov
93887371f3
Merge pull request #8716 from ClickHouse/bitCount-perf-test
Added performance test for bitCount function
2020-01-19 00:05:57 +03:00
Alexander Kazakov
be091a5133 Tiny optimization 2020-01-19 00:03:45 +03:00
Alexander Kazakov
f29db2ed68 Fixed problem with calculating ternary logic OPs in multiple batches 2020-01-19 00:02:43 +03:00
Alexander Kazakov
b2fd151dd0 More stable XorImpl code for XOR 2020-01-18 23:49:12 +03:00
Alexander Kazakov
0f22b5ec85 Fixed "newlines" 2020-01-18 23:45:41 +03:00
Alexey Milovidov
3c7df7ca31 Minor modifications 2020-01-18 23:42:50 +03:00
Alexander Kazakov
5fb75b3b9e Added tests for batched logical OPs 2020-01-18 23:35:12 +03:00
Alexey Milovidov
457c50c7d7 Code cleanups around 2020-01-18 23:19:10 +03:00
Alexey Milovidov
216b39a30d Minor changes for consistency 2020-01-18 23:15:49 +03:00
Alexey Milovidov
ac46498f60 Minor modification 2020-01-18 23:12:58 +03:00
Alexey Milovidov
f0b4fcee1f Minor modifications 2020-01-18 23:10:32 +03:00
Alexey Milovidov
85f2e86e5b Added performance test for Avro format 2020-01-18 23:10:11 +03:00
Alexey Milovidov
e6b407a961 Added TODO 2020-01-18 22:34:09 +03:00
Alexey Milovidov
997ea7ed53 Fixed error 2020-01-18 22:29:53 +03:00
Alexey Milovidov
f9e1f25189 Added comment to DiskMemory 2020-01-18 22:15:21 +03:00
Alexey Milovidov
76e04b9843 Merge branch 'avro' of https://github.com/oandrew/ClickHouse into oandrew-avro 2020-01-18 21:23:55 +03:00
alexey-milovidov
2ba89d169e
Merge branch 'master' into readline-to-replxx-docs-and-corrections 2020-01-18 20:58:24 +03:00
alexey-milovidov
52e8252653
Merge pull request #8650 from ClickHouse/remove_istorage_weak_ptr
Get rid of StorageWeakPtr
2020-01-18 20:28:53 +03:00
alexey-milovidov
3f3a9e69b0
Merge pull request #8672 from excitoon/patch-7
Fixed `MergeTreeData::areBackgroundMovesNeeded` according to move TTL feature
2020-01-18 20:20:00 +03:00
alexey-milovidov
85f395a8ee
Merge pull request #8680 from excitoon-favorites/criticalbugwithmove
Fixed a bug with double move which corrupt original part
2020-01-18 20:19:03 +03:00
alexey-milovidov
86a062110d
Merge pull request #8704 from kreuzerkrieg/MoreGCCWarnings
Enable -Wmissing-include-dirs for GCC
2020-01-18 20:12:56 +03:00
Alexey Milovidov
157e6539de Added performance test for bitCount function 2020-01-18 18:50:18 +03:00
alexey-milovidov
0ceed79d4e
Merge pull request #8710 from ClickHouse/ifNotFinite
Added function 'ifNotFinite'
2020-01-18 18:47:22 +03:00
Alexey Milovidov
c0a5c664a9 Replace readline to replxx: docs and corrections 2020-01-18 18:44:08 +03:00
Alexey Milovidov
f7efa5e2c7 Merge branch 'replxx' of https://github.com/abyss7/ClickHouse into abyss7-replxx 2020-01-18 17:00:59 +03:00
Alexey Milovidov
eeea89e0a4 Added test 2020-01-18 16:06:19 +03:00
Alexey Milovidov
71763c9ab6 Fixed error 2020-01-18 16:06:02 +03:00
Nikolai Kochetov
0fcb36ac7c Drop outputs in StrictResizeProcessor. 2020-01-18 14:39:48 +03:00
alexey-milovidov
3fe83a1006
Merge pull request #8708 from ClickHouse/bitCount
Added function bitCount
2020-01-18 14:37:08 +03:00
alexey-milovidov
3e680b59ee
Merge pull request #8709 from ClickHouse/client-clusters-in-suggest
Added cluster names to suggestions in interactive mode in clickhouse-client
2020-01-18 14:36:43 +03:00
alexey-milovidov
3f603b7141
Merge pull request #8711 from ClickHouse/speedup-exception-while-insert-test
Speedup "exception while insert" test
2020-01-18 14:33:32 +03:00
alexey-milovidov
b93309f1e2
Merge pull request #8712 from ClickHouse/benchmark-dont-interpolate-quantiles
Do not interpolate quantiles in clickhouse-benchmark
2020-01-18 14:33:03 +03:00
alexey-milovidov
e587e1baf8
Merge pull request #8713 from ClickHouse/join-add-test-just-in-case
Added a test from Bindu Madhavi
2020-01-18 14:30:28 +03:00
alexey-milovidov
e78a08cbaf
Merge pull request #8705 from ClickHouse/array-zip-mixed-const-fix
Fixed the case of mixed-constness of arguments of function arrayZip
2020-01-18 14:17:53 +03:00
kreuzerkrieg
0bf3ea4247 Enable -Wmissing-include-dirs for GCC 2020-01-18 10:46:27 +02:00
Alexey Milovidov
c152df4ed5 Added a test from Bindu Madhavi 2020-01-18 05:47:55 +03:00
Alexey Milovidov
9b5121d92e Do not interpolate quantiles in clickhouse-benchmark 2020-01-18 05:28:07 +03:00
Alexey Milovidov
9983835c8e Speedup "exception while insert" test 2020-01-18 04:52:01 +03:00
Alexey Milovidov
27b5f47282 Added function ifNotFinite 2020-01-18 04:07:11 +03:00
Alexey Milovidov
d270fb69b5 Added cluster names to suggestions in interactive mode in clickhouse-client 2020-01-18 03:32:16 +03:00
alexey-milovidov
90faa6ed5f
Update bitCount.cpp 2020-01-18 01:05:27 +03:00
alexey-milovidov
ec46c68a32
Update bitCount.cpp 2020-01-18 01:05:09 +03:00
Alexey Milovidov
8af3dda0bb Added comments 2020-01-17 23:00:46 +03:00
Alexey Milovidov
da1b51a496 Added function bitCount #8702 2020-01-17 22:57:03 +03:00
Alexander Kuzmenkov
8de0f4fc34 Avoid stale log files.
When the logging configuration changes, the logging-related data
structures on the server are not properly updated. This leads to a bug
where logs are written to old files, and it is impossible to fix without
restarting the server. The log file grows indefinitely and eventually
makes the server run out of disk space (see #8696). To avoid
catastrophic consequences, require that the server is restarted to apply
logging configuration changes, until the proper fix is developed.
2020-01-17 22:27:41 +03:00
Alexey Milovidov
3dec67ca6d Fixed the case of mixed-constness of arguments of function arrayZip 2020-01-17 22:16:02 +03:00
Nikolai Kochetov
61594edcee Fix StrictResize processor. 2020-01-17 20:04:37 +03:00
Vladimir Chebotarev
e7fb7d1288 Improved areBackgroundMovesNeeded() method. 2020-01-17 16:30:54 +03:00
Vladimir Chebotarev
0ba869a1ca Fixed MergeTreeData::areBackgroundMovesNeeded according to move TTL feature. 2020-01-17 16:24:44 +03:00
Vladimir Chebotarev
cb416b0bfd Minor review fixes. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
87ac7c59df Added concurrent test for ALTER MODIFY TTL. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
4f1f9e7e42 Fixed concurrency problems in ALTER MODIFY TTL. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
89d74a599b Fixed test_ttl_move::test_ttls_do_not_work_after_alter a little bit. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
585e0453a6 Added clearing of old DELETE expression during ALTER MODIFY TTL. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
17dfea217b Fixed errors with ALTER MODIFY TTL. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
614c45df16 Improved test_ttl_move::test_ttls_do_not_work_after_alter test (so that it does not pass anymore). 2020-01-17 16:17:17 +03:00
Pervakov Grigory
36e5322320 Fix remove in memory disk, fix style, change s3 object naming 2020-01-17 14:44:16 +03:00
Pervakov Grigory
b0b3842b57 Add remove to IDisk interface, fix issues 2020-01-17 14:34:39 +03:00
Pervakov Grigory
70e50ecf10 Base implementation of IDisk interafce for S3 2020-01-17 14:34:39 +03:00
Vladimir Chebotarev
451c8174c5 Added test for bug with double move which corrupt original part. 2020-01-17 12:46:44 +03:00
Alexander Kuzmenkov
7ae38a3400 [wip] performance comparison test 2020-01-16 22:39:07 +03:00
Nikolai Kochetov
7803e518c6 Remove query pipeline later. 2020-01-16 19:20:22 +03:00
Nikolai Kochetov
61e69c06d2 Fix MergingSortedTransform 2020-01-16 18:52:52 +03:00
Alexander Kuzmenkov
f81aa1c9f0 [wip] performance comparison test 2020-01-16 17:29:53 +03:00
Nikolai Kochetov
f6b9d320a9 Updates in AggregatingTransform 2020-01-16 15:50:04 +03:00
Vladimir Chebotarev
48855d9ba9 Added comment to cloned_part->renameTo(). 2020-01-16 14:52:43 +03:00
Nikolai Kochetov
5aa503beb3 Updates in AggregatingTransform and MergingSortedTransform. 2020-01-16 13:45:34 +03:00
alexey-milovidov
e409051304
Merge pull request #8663 from nikvas0/fix_lazy_db
Fix "DROP TABLE IF EXISTS" for lazy database
2020-01-16 13:24:37 +03:00
alexey-milovidov
f4dee9a76e
Merge pull request #8666 from ClickHouse/filimonov-typo-fix
typo fix
2020-01-16 13:24:00 +03:00
alexey-milovidov
1526a626ae
Merge pull request #8671 from excitoon-favorites/fixedmultiplediskstests
Fixed deduplication issues in more `test_multiple_disks` tests
2020-01-16 13:23:30 +03:00
Vladimir Chebotarev
3e5a6aa83d Fixed a bug with double move which corrupt original part. 2020-01-16 10:11:55 +03:00
Nikolai Kochetov
4b86ef22b5 Fix PipelineExecutor. 2020-01-15 21:32:19 +03:00
Nikolai Kochetov
5f5753941c Fix ports updating in PipelineExecutor. 2020-01-15 21:30:08 +03:00
Alexey Milovidov
06269e572f Added test 2020-01-15 21:19:46 +03:00
Alexey Milovidov
7ba06ccb82 Added method createColumn for DataTypeSet 2020-01-15 21:18:50 +03:00
Vladimir Chebotarev
f758b1f6c6 Fixed deduplication issues in more test_multiple_disks tests. 2020-01-15 18:25:23 +03:00
filimonov
5ae7a0337c
Update Settings.h 2020-01-15 14:51:06 +01:00
filimonov
ba4db6a71b
Update Settings.h 2020-01-15 14:38:05 +01:00
filimonov
681f5df66f
typo fix 2020-01-15 14:30:21 +01:00
Nikita Vasilev
54e7115ead test 2020-01-15 15:52:23 +03:00
Nikita Vasilev
a8e62788cd test 2020-01-15 15:49:38 +03:00
Alexander Tokmakov
5e2badd9b8 Merge branch 'master' into table_name_in_istorage 2020-01-15 14:55:20 +03:00
Nikita Vasilev
acf11000c6 fix bug 2020-01-15 14:52:30 +03:00
Nikolai Kochetov
ee3e7c1d5f Update PipelineExecutor. 2020-01-15 12:25:38 +03:00
Olga Khvostikova
53ae368d9c
Add virtual columns to hdfs and file table functions (#8489)
* Add virtual column _path to hdfs and file table functions with test

* Fix const of headers

* Add column _file with tests

* Add docs

* Fix improper resolve conflicts

* Fix links in docs

* Better condition for virtual columns proccessing in StorageFile

* better condition for virtual columns processing in StorageHDFS
2020-01-15 10:52:45 +03:00
alexey-milovidov
b6f41e4465
Merge pull request #8647 from qMBQx8GH/fix_max_depth
Initial commit to fix IParser::Pos.max_depth issue
2020-01-15 01:00:17 +03:00
alexey-milovidov
27f867061d
Merge pull request #8652 from ClickHouse/linear-regression-intel
Integrate patch for stochasticLinearRegression
2020-01-15 00:59:51 +03:00
alexey-milovidov
9c5c544f49
Merge pull request #8653 from ClickHouse/fix_system_metadata_path
Fix metadata path for system database
2020-01-15 00:59:24 +03:00
Alexey Milovidov
0a5fbdc01b Merge branch 'master' of github.com:yandex/ClickHouse 2020-01-14 22:24:03 +03:00
Nikolai Kochetov
eadf388cb0 Update ISimpleTransform. 2020-01-14 22:14:10 +03:00
Alexander Tokmakov
d51c3df7b6 fix 2020-01-14 22:01:56 +03:00
Alexey Milovidov
cf3e3b44bd Query profiler is production ready and enabled by default 2020-01-14 21:52:40 +03:00
alexey-milovidov
c9a781b099
Merge pull request #8648 from CurtizJ/rename-tests
Rename tests to be consistent with clickhouse-test options.
2020-01-14 21:37:43 +03:00
Nikita Mikhaylov
0e0dd80abf
Merge pull request #6168 from PerformanceVision/move_partition
Alter command for move a specific partition from MergeTree table
2020-01-14 22:32:10 +04:00
Alexey Milovidov
ba905e19bf Removed bunch of other solved tasks 2020-01-14 21:26:46 +03:00
alexey-milovidov
f460095319
Merge pull request #8651 from qoega/qoega/update-easy-tasks-1
Delete fixed tasks from easy tasks list
2020-01-14 21:18:32 +03:00
Nikolai Kochetov
77e04daaca Update ISimpleTransform. 2020-01-14 20:21:59 +03:00
Alexey Milovidov
975ae4c396 Integrate patch from Intel 2020-01-14 20:17:56 +03:00
Alexander Tokmakov
9521b0ebe5 remove proxystorage 2020-01-14 20:10:19 +03:00
Alexander Tokmakov
ff1b7e1386 get rid of StorageWeakPtr 2020-01-14 19:54:25 +03:00
Yatsishin Ilya
1e501da101 fixed add brotli #4388 2020-01-14 19:50:46 +03:00
Yatsishin Ilya
a1b1c5cd56 fixed static computable limits 2020-01-14 19:48:14 +03:00
Yatsishin Ilya
12bbdd8582 fixed clickhouse-local --time --progress 2020-01-14 19:43:50 +03:00
Yatsishin Ilya
7a6a5d77a9 fixed add topKWeighted 2020-01-14 19:41:08 +03:00
Yatsishin Ilya
7b59d7b102 fixed clickhouse-server --help 2020-01-14 19:40:26 +03:00
Yatsishin Ilya
6f530c8788 fixed add isValidUTF8 #4934 2020-01-14 19:39:30 +03:00
Yatsishin Ilya
97128ad5af fixed lower mark_cache, uncompressed_cache if system has low memory 2020-01-14 19:31:22 +03:00