Commit Graph

19189 Commits

Author SHA1 Message Date
Vitaly Baranov
e0fb03d1b6
Merge pull request #38970 from vitlibar/select-from-system-db-requires-grant
SELECT from the system database requires grant now
2022-07-16 22:37:47 +02:00
alesapin
afd5c40335
Merge pull request #39190 from ClickHouse/fix_race_with_concurrent_hardlinks
Fix extremely rare race condition in hardlinks creation
2022-07-16 13:57:02 +02:00
Ilya Yatsishin
43ed3df474
Merge pull request #39225 from qoega/query-log-fix-result-bytes 2022-07-15 23:46:03 +02:00
alesapin
ec15be2798 Add missed file 2022-07-15 19:00:50 +02:00
alesapin
39d61e9a37
Merge pull request #39064 from quickhouse/patch-1
More stable `test_s3_zero_copy_ttl`, weakened requirement to move data to S3 in 0-5 seconds
2022-07-15 17:58:58 +02:00
alesapin
3fe17518b9
Merge pull request #39187 from ClickHouse/roaring-memory-tracking-fix
Fix 01961_roaring_memory_tracking test
2022-07-15 17:56:11 +02:00
alesapin
5cf4bd50de
Merge pull request #39214 from azat/s3-fix-fetching-memory-part
Fix fetch of in-memory part with allow_remote_fs_zero_copy_replication
2022-07-15 17:52:05 +02:00
Alexander Tokmakov
90529f0d48
Merge pull request #39258 from ClickHouse/tavplubix-patch-1
Disable flaky test `test_s3_zero_copy_on_hybrid_storage`
2022-07-15 18:36:00 +03:00
Vitaly Baranov
5565089f44
Merge pull request #38933 from ClickHouse/simdjson-avx512-test
Add a test for simdjson
2022-07-15 16:48:08 +02:00
Nikolai Kochetov
f6a82a6a53
Merge pull request #39157 from ClickHouse/bug-lost-column
prewhere action should preserve sorting columns
2022-07-15 16:37:40 +02:00
Vitaly Baranov
5691a859d6 Add tests. 2022-07-15 15:44:29 +02:00
Vitaly Baranov
ef3a24d20f Fix tests. 2022-07-15 15:44:29 +02:00
Vitaly Baranov
6bf7bffbeb Correct the list of always accessible system tables. 2022-07-15 15:44:29 +02:00
Vitaly Baranov
fbb2e14d54 Add new table function viewIfPermitted(). 2022-07-15 15:44:29 +02:00
Vitaly Baranov
c85b2b5732 Add option enabling that SELECT from the system database requires grant. 2022-07-15 15:44:25 +02:00
alesapin
6c5de5a867 FIX BLACK 2022-07-15 15:34:44 +02:00
alesapin
cb6bc63af1 Better test 2022-07-15 14:43:27 +02:00
Anton Popov
da97a22465
Merge pull request #39243 from CurtizJ/send-logs-level-colors
Do not color logs on client if they are redirected to file
2022-07-15 13:33:13 +02:00
Alexander Tokmakov
c4cbefb521
Update test.py 2022-07-15 13:44:37 +03:00
alesapin
8d07a1427f
Update storage_conf.xml 2022-07-15 12:28:56 +02:00
Yatsishin Ilya
c133f27724 style again 2022-07-15 09:56:56 +00:00
alesapin
d4a24a5f8e Better test 2022-07-15 00:50:03 +02:00
alesapin
687961cf42 Fix style 2022-07-15 00:38:58 +02:00
alesapin
c7da3d61bf More stressful test 2022-07-15 00:32:20 +02:00
Yatsishin Ilya
4d96ff9b97 style 2022-07-14 22:25:10 +00:00
Ilya Yatsishin
d2b7257617
Update tests/queries/0_stateless/02356_insert_query_log_metrics.sql
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2022-07-15 00:12:38 +02:00
Anton Popov
efed134758 fix test 2022-07-14 21:48:34 +00:00
alesapin
1bc943264c Add concurrent backups test 2022-07-14 21:38:17 +02:00
Anton Popov
79e1d39211 do not color logs on client if redirected to file 2022-07-14 19:33:53 +00:00
Yatsishin Ilya
efb418a7e7 fix 2022-07-14 16:30:59 +00:00
Maksim Kita
f5bacedaf9
Merge pull request #38553 from hexiaoting/mapupdate_dev
Fix bug for mapUpdate
2022-07-14 17:59:37 +02:00
Yakov Olkhovskiy
1f09303d54
Merge pull request #39181 from azat/part_log-merge_algorithm
Add merge_algorithm to system.part_log
2022-07-14 11:43:04 -04:00
Yakov Olkhovskiy
9ecf19c883
Merge pull request #39212 from azat/stack_trace-filter-v2
Optimize accesses to system.stack_trace (filter by name before sending signal)
2022-07-14 10:33:26 -04:00
Yatsishin Ilya
32e48f661a Fixed query_log result_bytes metric that showed inseted rows instead of bytes 2022-07-14 12:51:56 +00:00
Kseniia Sumarokova
530dac6487
Merge pull request #37213 from aaapetrenko/master
add TableFunctionMongoDB and tests
2022-07-14 12:09:07 +02:00
Azat Khuzhin
531e3b13ce Optimize accesses to system.stack_trace (filter by name before sending signal)
Because of failed rebase/push this part of the patch was lost, so
resending separatelly (sigh).

Follow-up for: #39177 (cc @yakov-olkhovskiy)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-14 11:49:34 +03:00
Azat Khuzhin
3e77b80b88 Fix fetch of in-memory part with allow_remote_fs_zero_copy_replication
CI founds the following error during trying to fetch in-memory part [1]:

    2022.07.13 08:06:54.231033 [ 141093 ] {} <Error> InterserverIOHTTPHandler: Code: 107. DB::ErrnoException: Cannot open file /var/lib/clickhouse/disks/s3/store/886/88635b40-e4e3-4fe6-a0a0-1b6755463358/all_0_0_0/data.bin, errno: 2, strerror: No such file or directory. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):

<details>

<summary>stacktrace</summary>

    2022.07.13 08:06:54.101825 [ 189342 ] {8dbd11b3-f38a-4d5d-9ded-148987adb71d} <Debug> executeQuery: (from [::1]:54570) (comment: 01643_replicated_merge_tree_fsync_smoke.sql) select 'memory in_memory_parts_insert_sync'; (stage: Complete)
    2022.07.13 08:06:54.131309 [ 691 ] {} <Debug> test_26u6kx.rep_fsync_r2 (39c3823c-22e5-4c05-9dec-cdffd8872c40): Fetching part all_0_0_0 from /clickhouse/tables/test_26u6kx/rep_fsync/replicas/r1
    2022.07.13 08:06:54.231033 [ 141093 ] {} <Error> InterserverIOHTTPHandler: Code: 107. DB::ErrnoException: Cannot open file /var/lib/clickhouse/disks/s3/store/886/88635b40-e4e3-4fe6-a0a0-1b6755463358/all_0_0_0/data.bin, errno: 2, strerror: No such file or directory. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):
    0. DB::Exception::Exception() @ 0xba0191a in /usr/bin/clickhouse
    1. DB::throwFromErrnoWithPath() @ 0xba029ca in /usr/bin/clickhouse
    2. DB::OpenedFile::open() const @ 0x156e7fb0 in /usr/bin/clickhouse
    3. DB::OpenedFile::getFD() const @ 0x156e8003 in /usr/bin/clickhouse
    4. DB::ReadBufferFromFilePReadWithDescriptorsCache::ReadBufferFromFilePReadWithDescriptorsCache() @ 0x156e5f23 in /usr/bin/clickhouse
    5. ? @ 0x156e53f0 in /usr/bin/clickhouse
    6. DB::createReadBufferFromFileBase() @ 0x156e52b5 in /usr/bin/clickhouse
    7. DB::DiskLocal::readFile() const @ 0x15e45ea8 in /usr/bin/clickhouse
    8. DB::MetadataStorageFromDisk::readFileToString() const @ 0x15e6ab8b in /usr/bin/clickhouse
    9. DB::MetadataStorageFromDisk::readMetadataUnlocked() const @ 0x15e6cdeb in /usr/bin/clickhouse
    10. DB::MetadataStorageFromDisk::getSerializedMetadata() const @ 0x15e6cfc4 in /usr/bin/clickhouse
    11. DB::DiskObjectStorage::getSerializedMetadata() const @ 0x15e19e2e in /usr/bin/clickhouse
    12. DB::DiskDecorator::getSerializedMetadata() const @ 0x15e54ed1 in /usr/bin/clickhouse
    13. DB::DiskDecorator::getSerializedMetadata() const @ 0x15e54ed1 in /usr/bin/clickhouse
    14. DB::DataPartsExchange::Service::sendPartFromDiskRemoteMeta() @ 0x1700bb9e in /usr/bin/clickhouse
    15. DB::DataPartsExchange::Service::processQuery(DB::HTMLForm const&, DB::ReadBuffer&, DB::WriteBuffer&, DB::HTTPServerResponse&) @ 0x1700a649 in /usr/bin/clickhouse
    16. DB::InterserverIOHTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::InterserverIOHTTPHandler::Output&) @ 0x17433c53 in /usr/bin/clickhouse
    17. DB::InterserverIOHTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x174344f1 in /usr/bin/clickhouse
    18. DB::HTTPServerConnection::run() @ 0x1768714d in /usr/bin/clickhouse
    19. Poco::Net::TCPServerConnection::start() @ 0x1a398093 in /usr/bin/clickhouse
    20. Poco::Net::TCPServerDispatcher::run() @ 0x1a399411 in /usr/bin/clickhouse
    21. Poco::PooledThread::run() @ 0x1a54b7bb in /usr/bin/clickhouse
    22. Poco::ThreadImpl::runnableEntry(void*) @ 0x1a548ec0 in /usr/bin/clickhouse
    23. ? @ 0x7fdf1c204609 in ?
    24. clone @ 0x7fdf1c129133 in ?
     (version 22.7.1.1781 (official build))

</details>

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/0/8b6e31cc615ca52c80724b6e5097777cb9514f07/stateless_tests__release__s3_storage__actions_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-14 11:43:35 +03:00
Robert Schulze
110862a11e
Merge pull request #38502 from ClibMouse/Issue_38498
Fixed bug in parsing {..} regex
2022-07-14 08:27:31 +02:00
Yakov Olkhovskiy
d6a09acb38
Merge pull request #39177 from azat/stack_trace-filter
Optimize accesses to system.stack_trace
2022-07-14 01:47:14 -04:00
Nikolay Degterinsky
cfe7413678
Merge pull request #38935 from evillique/translate
Add functions translate & translateUTF8
2022-07-14 02:31:37 +02:00
Nikolai Kochetov
9528f7e753
Merge branch 'master' into bug-lost-column 2022-07-13 23:06:38 +02:00
Nikolai Kochetov
ba863b11a4 A little fix. Added test. 2022-07-13 21:06:15 +00:00
Kseniia Sumarokova
b4321904bf
Update test.py 2022-07-13 22:59:14 +02:00
Nikolai Kochetov
ee0f7658b5
Merge pull request #39173 from ClickHouse/add-test-for-39132
Add test for #39132
2022-07-13 22:53:59 +02:00
Anton Popov
5cb3b25754
Merge pull request #39161 from amosbird/text-log-source-regexp
Control send logs behavior with source name regexp
2022-07-13 21:13:54 +02:00
Kseniia Sumarokova
61ce5161f3
Merge pull request #39106 from kssenii/cache-cacth-disk-full-on-cache-write
fs cache: continue without exception when getting no disk space left error
2022-07-13 19:08:13 +02:00
mergify[bot]
79e6f85412
Merge branch 'master' into mapupdate_dev 2022-07-13 17:06:51 +00:00
Dmitry Novik
9e4f516f35
Merge pull request #39112 from ClickHouse/window-expressions-fix
Fix ActionsDAG construction for window expressions
2022-07-13 18:19:01 +02:00
Dmitry Novik
14aa62f661 Fix test output 2022-07-13 16:14:51 +00:00
Kseniia Sumarokova
765503cd61
Update test.py 2022-07-13 17:55:24 +02:00