thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-04 13:32:13 +00:00
Code Issues Packages Projects Releases Wiki Activity
103,860 Commits 9,179 Branches 1,782 Tags 2.3 GiB
cd0624e846
Commit Graph

5390 Commits

Author SHA1 Message Date
Sergei Trifonov
358c5a0139
Merge pull request #41532 from ClickHouse/s3-api-calls-events-for-disk-s3 
Detailed S3 profile events `DiskS3*` per S3 API call split for S3 ObjectStorage
 2022-09-20 02:10:50 +02:00
Vitaly Baranov
b1199878ad
Merge pull request #39977 from vitlibar/improve-recovery-of-replicated-access-storage 
Improve recovery of ReplicatedAccessStorage after errors.
 2022-09-20 00:36:30 +02:00
Sergei Trifonov
7902922ae4
Merge branch 'master' into readonly-settings-allow 2022-09-19 21:00:12 +02:00
serxa
7a1d4a404a add DiskS3* profile events per S3 API calls 2022-09-19 18:10:47 +00:00
serxa
f8aa738511 more conventional profile events names 2022-09-19 17:23:22 +00:00
Vitaly Baranov
052ecaa211
Merge branch 'master' into improve-recovery-of-replicated-access-storage 2022-09-19 15:26:21 +02:00
Vitaly Baranov
f75dd93965 Mask some information in logs. 2022-09-19 15:00:06 +02:00
Sergei Trifonov
ff2e1ff8d8
Merge branch 'master' into support_s3_api_event_metrics 2022-09-19 14:35:45 +02:00
Sergei Trifonov
26da32f53f
Update tests/integration/test_profile_events_s3/test.py 2022-09-19 14:35:23 +02:00
Alexander Tokmakov
c6efb1773e
Merge branch 'master' into fix_drop_partition_on_cluster 2022-09-19 15:18:05 +03:00
kssenii
e3cd3686af Rename 2022-09-19 14:02:51 +02:00
Sergei Trifonov
f7a1ed3141
Merge branch 'master' into readonly-settings-allow 2022-09-19 12:52:36 +02:00
Azat Khuzhin
00d4ac542d tests: fix test_hive_query flakiness 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-19 07:54:49 +02:00
alesapin
1d0dbfb112
Merge pull request #41444 from ClickHouse/one_wrong_config_assert 
One more validation for broken config in keeper
 2022-09-18 15:56:48 +02:00
Alexey Milovidov
6b752bff3a
Merge branch 'master' into revert_prefixes_s3 2022-09-18 07:10:57 +03:00
alesapin
b6d61318d0 One more validation for broken config in keeper 2022-09-18 00:04:16 +02:00
robot-clickhouse
838bc678cc Automatic style fix 2022-09-17 18:38:12 +00:00
Alexey Milovidov
c480531423 Remove trash error message from integration tests 2022-09-17 20:27:19 +02:00
Alexey Milovidov
ecfd8cb5a6 Remove trash error message from integration tests 2022-09-17 20:24:56 +02:00
Vitaly Baranov
406c76ee4e Fix test. 2022-09-16 19:02:06 +02:00
Vitaly Baranov
1206e77883 Add test checking that ReplicatedAccessStorage can continue after reloading ZooKeeper. 2022-09-16 19:02:06 +02:00
alesapin
456da30c9f Revert "Merge pull request #41249 from ClickHouse/revert-40968-s3-sharding-2" 
This reverts commit ac60300997, reversing
changes made to a9c272283a.
 2022-09-16 14:06:26 +02:00
Robert Schulze
b32b02d844
Merge pull request #40897 from ClickHouse/catboost-bridge-resurrected 
Move CatBoost evaluation into clickhouse-library-bridge
 2022-09-16 13:12:09 +02:00
alesapin
4e780cf99f
Merge pull request #41378 from ClickHouse/rename_test 
Check test flakiness
 2022-09-16 11:51:04 +02:00
Antonio Andelic
296fe01fb8 Merge branch 'master' into keeper-upload-snapshot-to-s3 2022-09-16 08:00:15 +00:00
Alexey Milovidov
da01982652
Merge pull request #41046 from azat/build/llvm-15 
Switch to llvm/clang 15
 2022-09-16 07:31:06 +03:00
Alexander Tokmakov
03c193ccca fix ON CLUSTER with Replicated database cluster 2022-09-15 21:15:57 +02:00
alesapin
1dd50e3ce8 Rename test 2022-09-15 17:07:42 +02:00
Antonio Andelic
c7775b7f16 Add tests for S3 snapshot upload 2022-09-15 13:37:17 +00:00
serxa
a960fdea89 Merge branch 'readonly-settings-allow' of github.com:ClickHouse/ClickHouse into readonly-settings-allow 2022-09-15 11:38:06 +00:00
serxa
4971c1f04d review fixes 2022-09-15 11:34:14 +00:00
kssenii
559c696230 Fix 2022-09-14 20:35:28 +02:00
mateng0915
372a0b7794 added events into s3 integration test 2022-09-14 19:19:47 +08:00
alesapin
51a302a70f
Merge branch 'master' into revert-40968-s3-sharding-2 2022-09-14 11:53:14 +02:00
Mikhail Filimonov
a136465eb4
Fix test integration/test_disk_types/test.py 2022-09-14 11:08:37 +02:00
Antonio Andelic
36f46891dd
Merge pull request #41215 from ClickHouse/keeper-close-connection-on-shutdown 
Close sessions on Keeper shutdown
 2022-09-13 19:09:34 +02:00
kssenii
420ac4eb43 s3 header auth in ast 2022-09-13 15:13:28 +02:00
Antonio Andelic
baf7255cff
Merge pull request #39976 from ClickHouse/keeper-storage 
KeeperMap storage engine
 2022-09-13 14:15:09 +02:00
Alexander Tokmakov
4d146b05a9
Merge pull request #38262 from PolyProgrammist/fix-ordinary-system-unfreeze 
Fix SYSTEM UNFREEZE for ordinary database
 2022-09-13 14:55:11 +03:00
alesapin
9af591a328
Revert "Sharding s3 key names (2)" 2022-09-13 12:29:02 +02:00
Antonio Andelic
45cde90219 Fix test 2022-09-13 09:51:31 +00:00
Sergei Trifonov
9cd78585c3 fix tests 2022-09-13 00:12:40 +02:00
Robert Schulze
fac1be9700
chore: restore SYSTEM RELOAD MODEL(S) and moniting view SYSTEM.MODELS 
- This commit restores statements "SYSTEM RELOAD MODEL(S)" which provide
  a mechanism to update a model explicitly. It also saves potentially
  unnecessary reloads of a model from disk after it's initial load.

  To keep the complexity low, the semantics of "SYSTEM RELOAD MODEL(S)
  was changed from eager to lazy. This means that both statements
  previously immedately reloaded the specified/all models, whereas now
  the statements only trigger an unload and the first call to
  catboostEvaluate() does the actual load.

- Monitoring view SYSTEM.MODELS is also restored but with some obsolete
  fields removed. The view was not documented in the past and for now it
  remains undocumented. The commit is thus not considered a breach of
  ClickHouse's public interface.
 2022-09-12 19:33:02 +00:00
Azat Khuzhin
b698a4ff65 Apply changes to http handlers on fly without server restart 
This has been implemented by simply restarting http servers in case of
http_handlers directive in configuration xml had been changed.

But, for this I have to change the handlers interface to accept
configuration separatelly, since the configuration that contains in the
server is the configuration with which server had been started.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Co-authored-by: Antonio Andelic
 2022-09-12 17:34:51 +02:00
Antonio Andelic
deee0d639f Address PR comments 2022-09-12 14:43:52 +00:00
Sergei Trifonov
fe88a7991d
Merge branch 'master' into readonly-settings-allow 2022-09-12 16:20:40 +02:00
Antonio Andelic
1cd43d8e5c Merge branch 'master' into keeper-storage 2022-09-12 13:42:51 +00:00
Antonio Andelic
e985ee3354 Close sessions on Keeper shutdown 2022-09-12 12:22:48 +00:00
kssenii
02c3d8b0a0 Fix 2022-09-11 16:42:56 +02:00
Alexey Milovidov
5802c2fdd2
Merge pull request #40713 from ClickHouse/remove-useless-line 
Remove one line from XML, because we do not care
 2022-09-11 09:53:30 +03:00
Alexey Milovidov
a5388affb8
Merge pull request #41023 from ClickHouse/remove-trash-3 
Remove trash from config
 2022-09-11 09:52:45 +03:00
Alexey Milovidov
91338ea771
Merge branch 'master' into remove-useless-line 2022-09-11 02:03:39 +03:00
Azat Khuzhin
46eafb4732 tests: skip test_send_crash_reports under ASan 
Since it also does not fits into timeouts [1]:

    2022-09-08 21:16:20 [ 377 ] DEBUG : Command:['docker', 'exec', '-u', 'root', 'roottestsendcrashreports_node_1', 'bash', '-c', 'pkill -SEGV clickhouse'] (cluster.py:95, run_and_check)
    ...
    2022-09-08 21:16:22 [ 377 ] DEBUG : run container_id:roottestsendcrashreports_node_1 detach:False nothrow:False cmd: ['cat', '/result.txt'] (cluster.py:1744, exec_in_container)
    ...
    2022-09-08 21:16:36 [ 377 ] DEBUG : Stdout:INITIAL_STATE (cluster.py:103, run_and_check)

And server logs:

    2022.09.08 21:16:21.112076 [ 228 ] {} <Fatal> BaseDaemon: ########################################
    2022.09.08 21:16:21.112170 [ 228 ] {} <Fatal> BaseDaemon: (version 22.9.1.1, build id: 0F7336E0A4D64134C51C8365DADCB78A9B39AA3B) (from thread 1) (no query) Received signal Segmentation fault (11)
    2022.09.08 21:16:21.112244 [ 228 ] {} <Fatal> BaseDaemon: Address: 0xde Access: read. Unknown si_code.
    2022.09.08 21:16:21.112321 [ 228 ] {} <Fatal> BaseDaemon: Stack trace: 0x7fbe21d09376 0x40a4f71a 0xe293a4b 0xdc5c51a 0x38dee227 0xdc326a0 0x38e319d9 0xdc2b4e2 0xdc25fdb 0x7fbe21b2c083 0xdb636ae
    2022.09.08 21:16:21.112419 [ 228 ] {} <Fatal> BaseDaemon: 3. pthread_cond_wait @ 0x7fbe21d09376 in ?
    2022.09.08 21:16:21.122914 [ 228 ] {} <Fatal> BaseDaemon: 4. ./build_docker/../contrib/libcxx/src/condition_variable.cpp:0: std::__1::condition_variable::wait(std::__1::unique_lock<std::__1::mutex>&) @ 0x40a4f71a in /usr/bin/clickhouse
    2022.09.08 21:16:21.233016 [ 228 ] {} <Fatal> BaseDaemon: 5.1. inlined from ./build_docker/../contrib/libcxx/include/atomic:952: unsigned long std::__1::__cxx_atomic_load<unsigned long>(std::__1::__cxx_atomic_base_impl<unsigned long> const*, std::__1::memory_order)
    2022.09.08 21:16:21.233135 [ 228 ] {} <Fatal> BaseDaemon: 5.2. inlined from ../contrib/libcxx/include/atomic:1582: std::__1::__atomic_base<unsigned long, false>::load(std::__1::memory_order) const
    2022.09.08 21:16:21.233183 [ 228 ] {} <Fatal> BaseDaemon: 5.3. inlined from ../contrib/libcxx/include/atomic:1586: std::__1::__atomic_base<unsigned long, false>::operator unsigned long() const
    2022.09.08 21:16:21.233234 [ 228 ] {} <Fatal> BaseDaemon: 5.4. inlined from ../src/Daemon/BaseDaemon.cpp:967: operator()
    2022.09.08 21:16:21.233303 [ 228 ] {} <Fatal> BaseDaemon: 5.5. inlined from ../contrib/libcxx/include/__mutex_base:402: void std::__1::condition_variable::wait<BaseDaemon::waitForTerminationRequest()::$_0>(std::__1::unique_lock<std::__1::mutex>&, BaseDaemon::waitForTerminationRequest()::$_0)
    2022.09.08 21:16:21.233334 [ 228 ] {} <Fatal> BaseDaemon: 5. ../src/Daemon/BaseDaemon.cpp:967: BaseDaemon::waitForTerminationRequest() @ 0xe293a4b in /usr/bin/clickhouse
    2022.09.08 21:16:21.350675 [ 228 ] {} <Fatal> BaseDaemon: 6. ./build_docker/../programs/server/Server.cpp:0: DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&) @ 0xdc5c51a in /usr/bin/clickhouse
    2022.09.08 21:16:21.394092 [ 228 ] {} <Fatal> BaseDaemon: 7. ./build_docker/../contrib/poco/Util/src/Application.cpp:0: Poco::Util::Application::run() @ 0x38dee227 in /usr/bin/clickhouse
    2022.09.08 21:16:21.654195 [ 228 ] {} <Fatal> BaseDaemon: 8. ./build_docker/../programs/server/Server.cpp:466: DB::Server::run() @ 0xdc326a0 in /usr/bin/clickhouse
    2022.09.08 21:16:21.666991 [ 228 ] {} <Fatal> BaseDaemon: 9. ./build_docker/../contrib/poco/Util/src/ServerApplication.cpp:0: Poco::Util::ServerApplication::run(int, char**) @ 0x38e319d9 in /usr/bin/clickhouse
    2022.09.08 21:16:21.916078 [ 228 ] {} <Fatal> BaseDaemon: 10. ./build_docker/../programs/server/Server.cpp:0: mainEntryClickHouseServer(int, char**) @ 0xdc2b4e2 in /usr/bin/clickhouse
    2022.09.08 21:16:21.929922 [ 228 ] {} <Fatal> BaseDaemon: 11. ./build_docker/../programs/main.cpp:0: main @ 0xdc25fdb in /usr/bin/clickhouse
    2022.09.08 21:16:21.929981 [ 228 ] {} <Fatal> BaseDaemon: 12. __libc_start_main @ 0x7fbe21b2c083 in ?
    2022.09.08 21:16:30.357032 [ 228 ] {} <Fatal> BaseDaemon: 13. _start @ 0xdb636ae in /usr/bin/clickhouse
    2022.09.08 21:16:31.383233 [ 228 ] {} <Fatal> BaseDaemon: Integrity check of the executable skipped because the reference checksum could not be read. (calculated checksum: 6200AC7C1270DC293DF3302E1C64399B)
    ...
    2022.09.08 21:16:40.564453 [ 228 ] {} <Information> SentryWriter: Sending crash report

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/41046/a0b85eaca8d4003c9fbc4571b30830d30f1984e9/integration_tests__asan__[3/3].html

Though another option is to increase waiting time.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-10 21:38:35 +02:00
robot-clickhouse
5bc2845e49 Automatic style fix 2022-09-10 03:17:34 +00:00
Alexey Milovidov
f2227e125f Fix test 2022-09-10 05:11:09 +02:00
Alexey Milovidov
61278c81e4 Merge branch 'master' into remove-useless-line 2022-09-10 05:07:10 +02:00
robot-clickhouse
79ccce23e9 Automatic style fix 2022-09-09 20:09:54 +00:00
Igor Nikonov
dbfb448290 Fix: integration test, standalone keeper mode 
There is logic regarding which keeper binary use to start keeper cluster in an integration test
There 2 options:
(1) standalone keeper binary (expected binary name clickhouse-keeper)
(2) clickhouse binary with keeper inside

Fixed:
- option (1) didn't work since docker_compose_keeper.yaml didn't create
target clickhouse-keeper at all
- if clickhouse-keeper existed, option (1) was taken but
  clickhouse-keeper could be just a link to clickhouse binary (the link
  is created always during build if cmake option BUILD_STANDALONE_KEEPER is OFF)
 2022-09-09 14:51:34 +00:00
robot-clickhouse
aeac3916ef Automatic style fix 2022-09-09 12:27:13 +00:00
Antonio Andelic
32483aeec8 Merge branch 'master' into keeper-storage 2022-09-09 12:24:01 +00:00
Sergei Trifonov
76eb001e78 add test for changeable_in_readonly + fix SQL in docs 2022-09-09 14:01:29 +02:00
Alexander Tokmakov
48927ba0ac
Merge branch 'master' into no-hardlinks-while-making-backup-of-mergetree-in-atomic-db 2022-09-09 14:24:44 +03:00
Vitaly Baranov
10629a66e5 Fix black. 2022-09-08 20:58:51 +02:00
Vitaly Baranov
e48cd2b6f6 Add more test cases. 2022-09-08 18:14:25 +02:00
robot-clickhouse
807b09f6b0 Automatic style fix 2022-09-08 15:52:00 +00:00
Sergei Trifonov
f92b6a6176
Merge branch 'master' into readonly-settings-allow 2022-09-08 17:44:32 +02:00
Sergei Trifonov
62541ab764 fix more tests and clang tidy build 2022-09-08 17:43:09 +02:00
Antonio Andelic
b99996961d Address PR comments 2022-09-08 12:45:36 +00:00
Vitaly Baranov
122009a2bd Use table lock if database is ordinary and zero-copy-replication is enabled. 2022-09-08 13:54:59 +02:00
Robert Schulze
c16707ff00
chore: delete obsolete modelEvaluate() function + SYSTEM.MODELS view 
- The deleted function modelEvaluate() was superseded by
  catboostEvaluate().

- Also delete the external model repository, as modelEvaluate() was it's
  last user. Additionally remove the system view SYSTEM.MODELS for
  inspecting the repository.

- SYSTEM RELOAD MODELS is also obsolete. HOWEVER, it was retained and
  made a no-op instead of deleted.

  Why?
  The reason is that RBAC in distributed setups works by storing
  privileges (granted and revoked) as plain SQL statements in Keeper.
  Nodes read these statements at startup and parse them. If a privilege
  for SYSTEM RELOAD MODELS exists but parser doesn't recognize it
  nodes would fail to come up.

  Considered but rejected alternatives:
  - Ignore SYSTEM RELOAD MODELS during parsing RBAC privileges and
    return an error for regular SYSTEM RELOAD MODELS SQL. Special-case
    of no-op behavior, too brittle.
  - Remove SYSTEM RELOAD MODELS manually from Keeper via command-line
    manipulation of Keeper nodes or via SQL by dropping the privileges.
    Needs user intervention during upgrade.
 2022-09-08 09:10:11 +00:00
Robert Schulze
60f9f6855d
feat: implement catboost in library-bridge 
This commit moves the catboost model evaluation out of the server
process into the library-bridge binary. This serves two goals: On the
one hand, crashes / memory corruptions of the catboost library no longer
affect the server. On the other hand, we can forbid loading dynamic
libraries in the server (catboost was the last consumer of this
functionality), thus improving security.

SQL syntax:

  SELECT
    catboostEvaluate('/path/to/model.bin', FEAT_1, ..., FEAT_N) > 0 AS prediction,
    ACTION AS target
  FROM amazon_train
  LIMIT 10

Required configuration:

  <catboost_lib_path>/path/to/libcatboostmodel.so</catboost_lib_path>

*** Implementation Details ***

The internal protocol between the server and the library-bridge is
simple:

- HTTP GET on path "/extdict_ping":
  A ping, used during the handshake to check if the library-bridge runs.

- HTTP POST on path "extdict_request"
  (1) Send a "catboost_GetTreeCount" request from the server to the
      bridge, containing a library path (e.g /home/user/libcatboost.so) and
      a model path (e.g. /home/user/model.bin). Rirst, this unloads the
      catboost library handler associated to the model path (if it was
      loaded), then loads the catboost library handler associated to the
      model path, then executes GetTreeCount() on the library handler and
      finally sends the result back to the server. Step (1) is called once
      by the server from FunctionCatBoostEvaluate::getReturnTypeImpl(). The
      library path handler is unloaded in the beginning because it contains
      state which may no longer be valid if the user runs
      catboost("/path/to/model.bin", ...) more than once and if "model.bin"
      was updated in between.
  (2) Send "catboost_Evaluate" from the server to the bridge, containing
      the model path and the features to run the interference on. Step (2)
      is called multiple times (once per chunk) by the server from function
      FunctionCatBoostEvaluate::executeImpl(). The library handler for the
      given model path is expected to be already loaded by Step (1).

Fixes #27870
 2022-09-08 09:01:32 +00:00
Vitaly Baranov
31ed722572
Merge pull request #41044 from vitlibar/more-conventional-conversion-yaml-to-xmk 
More conventional conversion yaml to xml
 2022-09-07 13:46:32 +02:00
Vitaly Baranov
9c847ceec9 No hardlinks while making backup of MergeTree in atomic database. 2022-09-07 11:44:50 +02:00
Daniil Rubin
f75376b7f8 Apply black formatter to tests 2022-09-07 11:05:40 +03:00
Daniil Rubin
4cc397da84 Add tests for deltalake storage 2022-09-07 11:05:40 +03:00
Daniil Rubin
0e9c3f299c Fix bug in test 2022-09-07 11:05:40 +03:00
Daniil Rubin
7d8cc20c46 Add select test 2022-09-07 11:05:40 +03:00
Daniil Rubin
6b95faf2b3 Add createquery test 2022-09-07 11:05:40 +03:00
Daniil Rubin
3e87fd0ee4 Add test template 2022-09-07 11:05:40 +03:00
Vitaly Baranov
63e992d52d Edit test configs. 2022-09-06 17:09:26 +02:00
Sergei Trifonov
6217559175
Merge branch 'master' into readonly-settings-allow 2022-09-06 16:10:48 +02:00
Antonio Andelic
5eb034a920 Merge branch 'master' into start-embedded-keeper-async 2022-09-06 12:14:47 +00:00
Antonio Andelic
4a68bfef39 Fix tests with async Keeper start 2022-09-06 12:12:17 +00:00
Sergei Trifonov
f77809ddbc
Merge pull request #40900 from ClickHouse/s3-detailed-metrics 
S3 detailed metrics
 2022-09-06 13:20:57 +02:00
Anton Ivashkin
e91d22a5b7 Merge branch 'fix-ordinary-system-unfreeze' of github.com:PolyProgrammist/ClickHouse into fix-ordinary-system-unfreeze 2022-09-06 12:18:05 +03:00
Anton Ivashkin
5e7cf1f238 Fix test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node] 2022-09-06 12:14:40 +03:00
Alexey Milovidov
59bd94dcf8
Merge pull request #40975 from vitlibar/fix-access-rights-for-describe 
Fix access rights for DESCRIBE TABLE
 2022-09-06 02:38:34 +03:00
Alexey Milovidov
4c30dbc905
Merge pull request #40968 from ClickHouse/s3-sharding-2 
Sharding s3 key names (2)
 2022-09-05 22:47:25 +03:00
ianton-ru
39e1fc7a0f
Merge branch 'master' into fix-ordinary-system-unfreeze 2022-09-05 17:10:59 +03:00
Sergei Trifonov
1c247308f1
Merge branch 'master' into s3-detailed-metrics 2022-09-05 15:55:41 +02:00
Sergei Trifonov
225773634c fix integration test for profile events s3 2022-09-05 15:54:28 +02:00
Kseniia Sumarokova
cff1dd6a8e
Merge branch 'master' into move-strange-test 2022-09-05 15:19:57 +02:00
Antonio Andelic
e07539d1b9 Merge branch 'master' into keeper-storage 2022-09-05 09:54:13 +00:00
Antonio Andelic
3a0581e990
Merge pull request #40543 from Lloyd-Pottiger/feat/support-read-only-for-embeddedrocksdb 
Add read-only support for EmbeddedRocksDB
 2022-09-05 09:31:07 +02:00
Alexey Milovidov
cda8052df0 Fix trash 2022-09-05 03:46:10 +02:00
Alexey Milovidov
e70d526896 Fix trash 2022-09-05 03:35:43 +02:00
Alexey Milovidov
bff96b0af6
Merge branch 'master' into fix-access-rights-for-describe 2022-09-05 04:34:57 +03:00
Alexey Milovidov
cc50aa39a2 Merge branch 's3-sharding-2' of github.com:ClickHouse/ClickHouse into s3-sharding-2 2022-09-05 02:25:01 +02:00
Alexey Milovidov
79e3723272 Merge branch 'master' into s3-sharding-2 2022-09-05 02:24:35 +02:00
robot-clickhouse
89d40b6f70 Automatic style fix 2022-09-05 00:23:36 +00:00
Alexey Milovidov
a0b5567d3e Move strange test 2022-09-05 02:16:48 +02:00
Alexey Milovidov
007680d93f Preparation 2022-09-05 02:13:51 +02:00
Vitaly Baranov
6c164905ca Add test. 2022-09-04 18:57:51 +02:00
Alexey Milovidov
c4adc9ed8f Remove trash 2022-09-04 04:28:08 +02:00
Alexey Milovidov
13a129bee7 Merge branch 'master' into remove-useless-line 2022-09-04 03:24:40 +02:00
Lloyd-Pottiger
ec68ed8a93 fix test 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
 2022-09-03 10:44:07 +08:00
Sergei Trifonov
005b2588d8
Merge branch 'master' into readonly-settings-allow 2022-09-02 16:37:43 +02:00
Lloyd-Pottiger
b76af9284e style check 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
 2022-09-02 19:29:57 +08:00
Lloyd-Pottiger
f499381f57 move functional test to integration test 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
 2022-09-02 18:45:37 +08:00
Antonio Andelic
9ca20b97c2
Merge branch 'master' into keeper-storage 2022-09-02 12:13:07 +02:00
Lloyd-Pottiger
5a6b2106b5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into feat/support-read-only-for-embeddedrocksdb 2022-09-02 18:10:00 +08:00
robot-clickhouse
46f74fcbaf Automatic style fix 2022-09-02 07:49:09 +00:00
Antonio Andelic
b02bf49939 Use path prefix 2022-09-02 07:34:26 +00:00
Lloyd-Pottiger
59dccd6e49 fix test 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
 2022-09-02 11:14:49 +08:00
Sergei Trifonov
7fec55eea4 work in progress 2022-09-02 04:12:05 +02:00
Frank Chen
9d63cbe811 Merge 'origin/master' into tracing_context_propagation to resolve conflicts 2022-09-01 23:18:59 +08:00
Vitaly Baranov
6dcca686cb
Merge pull request #40827 from vitlibar/fix-incremental-backups-for-log-family 
Fix incremental backups for Log family.
 2022-09-01 13:13:32 +02:00
Sema Checherinda
7b59fdc042
Merge pull request #40779 from CheSema/detached-parts-metric 
Metric for the number of detached parts
 2022-09-01 12:24:42 +02:00
Vitaly Baranov
007ae0e6cc Fix incremental backups for Log family. 2022-08-31 12:57:28 +02:00
Antonio Andelic
9dd1a9859d Merge branch 'master' into keeper-storage 2022-08-31 10:12:11 +00:00
root
ea517de61a style check correction 2022-08-30 23:20:19 -03:00
root
f02f7ce99c addressed minor change requests 2022-08-30 23:20:19 -03:00
root
84a617675d style check correction in test.py 2022-08-30 23:20:19 -03:00
root
3ced3c9933 style check correction in test.py 2022-08-30 23:20:19 -03:00
root
1d29a494db Modified test code to cover various scenarios for custom keys 2022-08-30 23:20:19 -03:00
root
d5db88fa27 Structured-logging-custom-keys PR init 2022-08-30 23:20:19 -03:00
Sema Checherinda
9bb4f556c3 work on remarks on the review 2022-08-30 20:18:35 +02:00
Antonio Andelic
3c098bd0cb Add integration test for KeeperMap 2022-08-30 13:41:57 +00:00
Alexander Tokmakov
022f440ad0
Merge pull request #40769 from arthurpassos/caresptrresolver-hosts-patch 
Fix CaresPTRResolver not reading hosts file
 2022-08-30 14:35:10 +03:00
alesapin
2588901bc9
Merge pull request #40780 from ClickHouse/add_cache_to_zero_copy_test 
Add cache to zero copy replication test
 2022-08-30 12:42:05 +02:00
Kseniia Sumarokova
c88db2ef97
Merge pull request #40751 from kssenii/fix-mysql-timeouts 
Fix issue with mysql db / table function timeouts
 2022-08-30 11:59:01 +02:00
Frank Chen
f17d56b528 Merge branch 'master' into tracing_context_propagation 2022-08-30 14:24:36 +08:00
Sema Checherinda
e436b4f4cc Metric for the number of detached parts 2022-08-30 02:12:57 +02:00
alesapin
ac41de73df Add cache to zero copy replication test 2022-08-30 00:17:01 +02:00
Kseniia Sumarokova
8001560082
Fix test 2022-08-30 00:14:00 +02:00
Vitaly Baranov
33f72fb011
Merge pull request #40060 from ClickHouse/vitlibar-increase-timeout-for-test_concurrent_backups 
Increase timeout for test_concurrent_backups
 2022-08-29 22:25:56 +02:00
Arthur Passos
dd49b44abb Fix host_regexp hosts file tst 2022-08-29 15:58:18 -03:00
Arthur Passos
961365c7a4 Fix CaresPTRResolver not reading hosts file 2022-08-29 15:11:39 -03:00
Kseniia Sumarokova
c5c48e44ea
Merge branch 'master' into fix-mysql-timeouts 2022-08-29 19:33:29 +02:00
kssenii
0a6c4b9265 Fix 2022-08-29 16:20:53 +02:00
Vladimir C
5cbe7e0846
Merge pull request #40548 from ClickHouse/vdimir/warn-suppress-40330 
Add config option warning_supress_regexp
 2022-08-29 14:02:00 +02:00
Alexander Tokmakov
8d90d30d37
Merge pull request #40589 from ClickHouse/remove_wrong_code_from_mutations 
Remove wrong code for skipping mutations in MergeTree
 2022-08-29 14:18:59 +03:00
Alexander Tokmakov
eda0582ec0
Merge pull request #40641 from ClickHouse/fix_startup_of_dropped_replica 
Do not try to strartup dropped replica
 2022-08-29 14:15:15 +03:00
Vitaly Baranov
2bec3d3a7c Increase timeout for test_concurrent_backups 2022-08-29 13:13:43 +02:00
alesapin
7ce0afc0df
Merge pull request #40670 from Avogar/kafka 
Add setting to disable limit on kafka_num_consumers
 2022-08-29 10:53:35 +02:00
Alexey Milovidov
b72fceb441
Merge pull request #40708 from lesandie/test_s3_table_functions 
Added integration test for s3 table function
 2022-08-29 03:49:53 +03:00
Alexey Milovidov
f462160bd1 Merge remote-tracking branch 'origin/master' into remove-useless-line 2022-08-28 21:00:29 +02:00
Diego Nieto (lesandie)
3d50dbea34 Black reformatting 2022-08-28 20:05:39 +02:00
Alexey Milovidov
fc29303ff3
Merge pull request #40685 from ClickHouse/nlp-functional-test 
Rewrite NLP tests from integration to functional
 2022-08-28 17:05:42 +03:00
Alexey Milovidov
f518844f06
Merge pull request #40709 from ClickHouse/all_new_table_functions_must_be_documented 
All new table functions must be documented
 2022-08-28 17:05:20 +03:00
Alexey Milovidov
18c56b722f Fix integration test 2022-08-28 04:30:27 +02:00
Alexey Milovidov
b42d26acfe Remove one line from XML, because we do not care 2022-08-28 02:44:02 +02:00
Alexey Milovidov
5b57c91ad6 Rename table function MeiliSearch to meilisearch 2022-08-28 02:08:51 +02:00
Diego Nieto (lesandie)
9a07489151 Added integration test for s3 table function 2022-08-27 18:33:04 +02:00
Alexey Milovidov
6414a01987 Rewrite NLP tests from integration to functional 2022-08-26 22:36:34 +02:00
Kruglov Pavel
d4d0ec1c95
Fix style 2022-08-26 16:44:54 +02:00
Alexander Tokmakov
7fa0cc02f2 fix tests 2022-08-26 15:33:04 +02:00
avogar
b8061532ac Add setting to disable limit on kafka_num_consumers 2022-08-26 12:49:39 +00:00
Kseniia Sumarokova
47d48a7b5c
Merge pull request #40579 from kssenii/add-test 
Add test for drop fs cache on cluster
 2022-08-26 12:55:13 +02:00
Lloyd-Pottiger
0d33327eda
Merge branch 'master' into feat/support-read-only-for-embeddedrocksdb 2022-08-26 15:36:21 +08:00
Kseniia Sumarokova
e2014c9872
Update test.py 2022-08-25 23:01:31 +02:00
Alexander Tokmakov
eae2667a1c
Merge pull request #40148 from ClickHouse/replicate-tables-readonly 
`ReplicatedMergeTree` tables as readonly until attach is finished
 2022-08-25 19:39:19 +03:00
Kseniia Sumarokova
e46d34c722
Update test.py 2022-08-25 18:37:25 +02:00
Alexander Tokmakov
a6f55b1430 fix 2022-08-25 16:27:12 +02:00
robot-clickhouse
6e538f04c4 Automatic style fix 2022-08-25 12:30:57 +00:00
Alexander Tokmakov
0aea4c7184 fix 2022-08-25 14:22:27 +02:00
alesapin
7d1e3ecfa3
Merge pull request #40506 from ClickHouse/fix_bad_exception 
Fix lost errors in AWS CPP SDK
 2022-08-25 13:07:35 +02:00
alesapin
c4f8811701
Merge pull request #40395 from ClickHouse/data_source_description 
Add copy shortcut for backups if dest and source support it
 2022-08-25 12:36:30 +02:00
Kseniia Sumarokova
73bb5a6b9e
Update test.py 2022-08-25 12:10:46 +02:00
robot-clickhouse
669ae365c1 Automatic style fix 2022-08-25 11:00:01 +02:00
vdimir
8bc29abdfa Test warning_supress_regexp in test_log_levels_update 2022-08-25 11:00:01 +02:00
Frank Chen
99c37ce6c6
Merge branch 'master' into tracing_context_propagation 2022-08-25 10:07:16 +08:00
Kseniia Sumarokova
bfc3180c9e
Update test.py 2022-08-25 00:20:50 +02:00
Alexey Milovidov
aaafb797c0
Merge pull request #40541 from ClickHouse/paranoid_check_for_s3_uploads 
Add paranoid option to check blobs to S3 after upload
 2022-08-24 23:51:22 +02:00
Alexander Tokmakov
3cd26aafe4 remove wrong code for skipping mutations in MergeTree 2022-08-24 20:58:59 +02:00
Antonio Andelic
da0d6056f4 Merge branch 'master' into replicate-tables-readonly 2022-08-24 17:29:33 +00:00
Lloyd-Pottiger
9d7ace3286
Merge branch 'master' into feat/support-read-only-for-embeddedrocksdb 2022-08-24 23:52:34 +08:00
Lloyd-Pottiger
dc64341876 add tests 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
 2022-08-24 23:42:13 +08:00
Alexander Tokmakov
f68db41c1c
Merge pull request #40575 from Avogar/try-fix-s3-test 
Fix flaky schema inference cache tests
 2022-08-24 18:24:05 +03:00
alesapin
eeb0a3584e Merge branch 'master' into data_source_description 2022-08-24 15:26:18 +02:00
Kseniia Sumarokova
6ac35dabcf
Update test.py 2022-08-24 15:03:02 +02:00
kssenii
1033c14859 Add test 2022-08-24 15:01:21 +02:00
alesapin
f0b733313f Merge branch 'master' into fix_bad_exception 2022-08-24 14:44:40 +02:00
alesapin
cac3005f4d Merge branch 'master' into paranoid_check_for_s3_uploads 2022-08-24 14:43:11 +02:00
Alexander Tokmakov
f9f85a0e8b Revert "Parallel distributed insert select from *Cluster table functions (#39107)" 
This reverts commit d3cc234986.
 2022-08-24 15:17:15 +03:00
avogar
93d0113b14 Fix flacky schema inference cache tests 2022-08-24 11:28:56 +00:00
Alexander Tokmakov
c1d933b746
Update test.py 2022-08-24 13:39:45 +03:00
alesapin
dc95d86d6e
Merge pull request #40064 from ClickHouse/keeper-force-recovery-more-retries 
Add retries for more commands in `test_keeper_force_recovery`
 2022-08-23 15:44:28 +02:00
robot-clickhouse
f0b18a1082 Automatic style fix 2022-08-23 13:21:29 +00:00
alesapin
07286dd042 Add paranoid option to check blobs to S3 after upload 2022-08-23 15:12:09 +02:00
alesapin
7c7fa9472f One more comment 2022-08-23 14:07:50 +02:00
alesapin
2f478774e5 Add comment to proxy 2022-08-23 14:05:05 +02:00
Vadim Volodin
9c371d518f fix enable_unfreeze handler and sanitizer hints 2022-08-23 13:53:06 +03:00
alesapin
802d56df49 Merge branch 'master' into fix_bad_exception 2022-08-23 12:22:05 +02:00
Antonio Andelic
0765495be1
Merge pull request #39986 from Lloyd-Pottiger/feat/support-ttl-for-embeddedrocksdb 
Support TTL for EmbeddedRocksDB
 2022-08-23 08:27:47 +02:00
robot-clickhouse
315d38c365 Automatic style fix 2022-08-22 22:43:00 +00:00
alesapin
780f39b108 Fix lost errors in AWS CPP SDK 2022-08-23 00:34:39 +02:00
Lloyd-Pottiger
85a1a36167 remove read_only option 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
 2022-08-22 23:31:55 +08:00
alesapin
b4d6afd5b3 Black 2022-08-22 13:51:48 +02:00
alesapin
704d7fdc41 Fix copy and use disks 2022-08-21 18:18:35 +02:00
Antonio Andelic
76ecb28daf Increase timeouts 2022-08-20 11:52:10 +00:00
Frank Chen
024fef1aec
Merge branch 'master' into tracing_context_propagation 2022-08-20 14:23:36 +08:00
Azat Khuzhin
b92d8b302a tests: fix test_storage_s3::test_wrong_format_usage flakiness 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-19 21:51:23 +02:00
Sergei Trifonov
7c18d5b34f
Merge pull request #40348 from ClickHouse/threads-soft-limit-rename 
split concurrent_threads_soft_limit setting into two
 2022-08-19 13:39:32 +02:00
Kruglov Pavel
c4f9508b80
Merge pull request #40355 from Avogar/better-schema-cache-test 
Make test for s3 schema inference cache better
 2022-08-19 12:17:49 +02:00
Antonio Andelic
5e2c8869a9 Merge branch 'master' into replicate-tables-readonly 2022-08-19 09:41:11 +00:00
Antonio Andelic
3f7d28cc6b Address PR comments 2022-08-19 09:39:59 +00:00
Lloyd-Pottiger
51f53af482 fix tests 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
 2022-08-19 15:24:00 +08:00
avogar
67f848a428 Fix style 2022-08-18 17:15:30 +00:00
avogar
1fb99f51b0 Make test for s3 schema inference cache better 2022-08-18 16:50:59 +00:00
Frank Chen
a3b6ad2a65
Merge branch 'master' into tracing_context_propagation 2022-08-18 20:59:07 +08:00
Sergei Trifonov
42a711015f split concurrent_threads_soft_limit setting into two: concurrent_threads_soft_limit_{num,ratio_to_cores} 2022-08-18 14:51:08 +02:00
Nikolai Kochetov
5a85531ef7
Merge pull request #38286 from Avogar/schema-inference-cache 
Add schema inference cache for s3/hdfs/file/url
 2022-08-18 13:07:50 +02:00
Kseniia Sumarokova
d8fd1f9c37
Merge pull request #36171 from kssenii/make-cache-composable 
Make cache composable, allow not to evict certain files (regarding .idx, .mrk, ..), delete old cache version
 2022-08-18 12:37:34 +02:00
Vladimir C
7ac0eb1af1
Merge pull request #40035 from ClickHouse/vdimir/cluster-discovery-observer 
Add observer mode to (zoo)keeper cluster discovery feature
 2022-08-18 10:53:49 +02:00
Lloyd-Pottiger
340c8d1c18 address comments 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
 2022-08-17 23:27:18 +08:00
Lloyd-Pottiger
19c4385881
Merge branch 'master' into feat/support-ttl-for-embeddedrocksdb 2022-08-17 22:17:10 +08:00
kssenii
d63d34f7bb Merge master 2022-08-17 15:49:32 +02:00
avogar
4c64b7a69e Try fix s3 test 2022-08-17 12:25:58 +00:00
avogar
8dd54c043d Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-cache 2022-08-17 11:47:40 +00:00
Alexander Tokmakov
caa270b72a
Merge pull request #39933 from ClickHouse/auto_convert_ordinary_to_atomic 
Add flag that enables automatic conversion from Ordinary to Atomic
 2022-08-17 12:40:49 +03:00
Nikita Mikhaylov
a7c3f23dfb
Merge branch 'master' into auto_convert_ordinary_to_atomic 2022-08-17 00:38:25 +02:00
Kruglov Pavel
afd5221d58
FIx check black 2022-08-16 18:53:55 +02:00
avogar
d5f7337ba3 Try fix tests 2022-08-16 14:57:19 +00:00
Alexander Tokmakov
832d7c6e7c Merge branch 'master' into replicated_database_improvements 2022-08-16 15:49:13 +02:00
Kruglov Pavel
169b38c878
Fix s3 test 2022-08-16 12:40:10 +02:00
Kruglov Pavel
795262f16c
Fix hdfs test 2022-08-16 12:39:35 +02:00
Antonio Andelic
2ed42bca7e Merge branch 'master' into replicate-tables-readonly 2022-08-16 08:17:53 +00:00
Alexander Tokmakov
1e6f7a7c52 make it work with python3.8 2022-08-16 09:35:45 +02:00
kssenii
eb26b219b9 Merge master 2022-08-16 00:56:27 +02:00
robot-clickhouse
1b11a5c6fe Automatic style fix 2022-08-15 20:19:41 +00:00
Alexander Tokmakov
26c2a0ce5e try to print stacktraces if query timeouts 2022-08-15 22:12:07 +02:00
avogar
c4ff3ffeea Rename settings 2022-08-15 12:45:18 +00:00
Nikita Mikhaylov
d3cc234986
Parallel distributed insert select from *Cluster table functions (#39107) 2022-08-15 12:41:17 +02:00
Alexey Milovidov
3a5f05bd22
Merge pull request #40175 from ClickHouse/disable-zero-copy-replication 
Disable zero-copy replication by default
 2022-08-14 12:47:38 +03:00
Alexey Milovidov
216c1d8efa
Revert "Use separate counter for RSS in global memory tracker." 2022-08-14 09:50:12 +03:00
Alexey Milovidov
b5e3d908e2 Fix tests 2022-08-14 04:11:17 +02:00
Alexey Milovidov
91042e9dd8 Update test configs 2022-08-14 01:43:24 +02:00
vdimir
89dca02e1d
Fix ClusterDiscovery 2022-08-12 13:26:17 +00:00
vdimir
e15f20e2e3
Update test_cluster_discovery/test.py 2022-08-12 13:26:16 +00:00
robot-clickhouse
66269cf6c9
Automatic style fix 2022-08-12 13:26:16 +00:00
vdimir
cef6c4f8ce
Add observer mode to (zoo)keeper cluster discovery feature 2022-08-12 13:26:12 +00:00
robot-clickhouse
479c945c3b Automatic style fix 2022-08-12 12:16:50 +00:00
Antonio Andelic
c6b3a897d2 Test replicated table without ZK, small fixes 2022-08-12 11:56:46 +00:00
kssenii
768a207176 Merge master 2022-08-11 22:25:53 +02:00
avogar
c0bb6303b9 Fix check black 2022-08-11 10:55:18 +00:00
Nikolai Kochetov
971d94e492
Merge pull request #38682 from ClickHouse/separate-counter-for-rss-in-memory-tracker 
Use separate counter for RSS in global memory tracker.
 2022-08-11 10:11:18 +02:00
Alexey Milovidov
8374f31306
Merge pull request #39425 from arenadata/ADQM-485 
Add support of dates from year 1900 to 2299 for Date32 and DateTime64
 2022-08-11 05:01:53 +03:00
Anton Popov
3fdf428834
Merge pull request #39186 from Avogar/numbers-schema-inference 
Add new features in schema inference
 2022-08-11 00:53:54 +02:00
Nikolay Degterinsky
496568101f
Merge pull request #39277 from ClibMouse/Structured-Logging-Support 
Structured logging support
 2022-08-10 22:57:48 +02:00
Nikita Mikhaylov
8e8e845a89
Merge branch 'master' into separate-counter-for-rss-in-memory-tracker 2022-08-10 16:44:24 +02:00
Lloyd-Pottiger
5488a392ab address comments 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
 2022-08-10 21:20:25 +08:00
Antonio Andelic
d8f3511b9e add more retries 2022-08-10 12:39:20 +00:00
kssenii
5c3227ba56 Merge master 2022-08-10 12:00:34 +02:00
Sema Checherinda
de49e1ae9a
Merge pull request #40007 from CheSema/no-ip-for-certs 
remove using fixed IP from tests with SSL
 2022-08-09 23:06:37 +02:00
Mallik Hassan
666fb8dc42
Merge branch 'ClickHouse:master' into Structured-Logging-Support 2022-08-09 15:39:00 -03:00
Nikolai Kochetov
fe6533f41d Disable test for sanitizers. 2022-08-09 12:25:58 +00:00
Kruglov Pavel
088e8cf9bd
Merge branch 'master' into numbers-schema-inference 2022-08-09 14:00:36 +02:00
Sema Checherinda
b3df5fe951
Update test.py 2022-08-09 12:52:16 +02:00
Sema Checherinda
59cb67c1f6
Update test.py 2022-08-09 12:50:54 +02:00
Sema Checherinda
d5c7cd0ef3
Update test.py 2022-08-09 12:50:28 +02:00
Sema Checherinda
070a39543b
Update tests/integration/test_tlsv1_3/test.py 
fix comment

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
 2022-08-09 12:48:31 +02:00
Sema Checherinda
4956e9dc49
Update parallel_skip.json 
no comma at the end of file
 2022-08-09 12:47:19 +02:00
Sema Checherinda
fd0aff444a regenerate certificates 2022-08-09 12:02:23 +02:00
Sema Checherinda
8dd6540dac reenable parallel execution for test_grpc_protocol_ssl test_ssl_cert_authentication test_tlsv1_3 2022-08-09 12:01:38 +02:00
Sema Checherinda
2c84fcdc3b test_grpc_protocol_ssl test_ssl_cert_authentication test_tlsv1_3 don't use fixed IP for instances 2022-08-09 12:01:15 +02:00
Nikolai Kochetov
8a4c57f641 Added __init__.py 2022-08-08 16:41:11 +00:00
Alexander Tokmakov
2c5da1466d Merge branch 'master' into replicated_database_improvements 2022-08-08 16:08:27 +02:00
Alexander Tokmakov
848511affb take permanently detached tables into account 2022-08-08 16:06:08 +02:00
robot-clickhouse
f10d4f6c61 Automatic style fix 2022-08-08 13:46:38 +00:00
Nikolai Kochetov
540ae64f37 Fix big memory usage for fetch. 2022-08-08 13:32:49 +00:00
Robert Schulze
ad0d060dc1
Merge pull request #39904 from ClickHouse/library-bridge-refactoring 
Prepare library-bridge for catboost integration
 2022-08-08 12:15:01 +02:00
Alexey Milovidov
0921548a37
Merge pull request #39527 from pkit/pkit/fix_nats_tls 
fix nats-io TLS support
 2022-08-08 08:28:14 +03:00
Alexander Tokmakov
f2c4cad255 add flag that enables automatic canversion from Ordinary to Atomic 2022-08-05 21:41:25 +02:00
avogar
9b1a267203 Refactor, remove TTL, add size limit, add system table and system query 2022-08-05 16:20:15 +00:00
Nikolai Kochetov
c6e3e14bcc
Merge pull request #39184 from ClickHouse/respect-remote_url_allow_hosts-for-other-dict-sources 
Respect remote_url_allow_hosts in relevant dictionary sources.
 2022-08-05 17:25:53 +02:00
kssenii
91f4143b6e Merge master 2022-08-05 12:14:08 +02:00
Alexander Tokmakov
65e1ce8ad1
Merge pull request #39674 from tonickkozlov/tonickkozlov/fix-default-database-resolution 
Default database resolution in distributed reads
 2022-08-05 13:09:15 +03:00
alesapin
329120ca7a
Merge pull request #39755 from ClickHouse/keeper-create-snapshot-on-exit 
Create Keeper snapshot on exit
 2022-08-05 12:00:16 +02:00
Alexander Tokmakov
d9190a8121
Merge pull request #39872 from ClickHouse/store_cleanup_all_disks 
Cleanup unused dirs from `store/` on all disks
 2022-08-05 12:21:59 +03:00
Constantine Peresypkin
10c76917ea fix nats-io TLS support 
nats-io library needs `NATS_HAS_TLS` define to correctly compile-in TLS
support

fixes #39525
 2022-08-05 11:20:05 +02:00
kssenii
7a9b0bc47f Merge master 2022-08-05 01:48:52 +02:00
Robert Schulze
7df30747f3
Typos 2022-08-04 19:27:38 +00:00
Alexander Tokmakov
110b60e5b7 fix tests 2022-08-04 19:48:55 +02:00
Alexander Tokmakov
460f2f2e39 Merge branch 'master' into store_cleanup_all_disks 2022-08-04 19:48:41 +02:00
Alexander Tokmakov
ebbaed46bd Merge branch 'master' into tonickkozlov/fix-default-database-resolution 2022-08-04 15:20:44 +02:00
Antonio Andelic
07a85513e8 Merge branch 'master' into keeper-create-snapshot-on-exit 2022-08-04 13:12:26 +00:00
Ilya Yatsishin
cecdc313d8
Merge branch 'master' into integration-tests-7 2022-08-04 11:37:16 +02:00
Alexander Tokmakov
1133425624
Update storage_conf.xml 2022-08-04 12:16:38 +03:00
Vitaly Baranov
a952a5dfe5
Merge pull request #39859 from vitlibar/fix-flaky-test_async_backups_to_same_destination 
Fix flaky integration test test_async_backups_to_same_destination.
 2022-08-04 09:46:25 +02:00
Antonio Andelic
8094f33078 Add init file for test 2022-08-04 06:48:33 +00:00
Alexey Milovidov
9e46abc560
Merge pull request #39420 from amosbird/better-projection1-fix1 
Normalize AggregateFunction types and state representations
 2022-08-04 03:06:55 +03:00
Alexander Tokmakov
a269cf29e4 remove unused dirs from store on all disks 2022-08-03 19:49:16 +02:00
Vitaly Baranov
dc25f18f13 Fix flaky integration test test_async_backups_to_same_destination. 2022-08-03 14:22:09 +02:00
Frank Chen
4e1ef89c64 Fix query in test case to match new behaviour 2022-08-03 19:44:11 +08:00
kssenii
d9c681d1f9 Fix checks 2022-08-03 12:52:08 +02:00
Kruglov Pavel
6b2186bfeb
Merge branch 'master' into numbers-schema-inference 2022-08-02 19:34:53 +02:00
Mallik Hassan
87bde54ee5
Merge branch 'ClickHouse:master' into Structured-Logging-Support 2022-08-02 10:44:05 -03:00
kssenii
d462782d1a Fix checks 2022-08-02 14:27:45 +02:00
root
495df1da07 reformat test.py to avoid style-check error 2022-08-01 20:48:57 -07:00
root
433b961d5c changed code for expected seg fault 2022-08-01 20:21:48 -07:00
kssenii
2850f68ac9 Fix checks 2022-08-01 20:48:05 +02:00
Alexander Tokmakov
1567b65473 Merge branch 'master' into replicated_database_improvements 2022-08-01 19:12:37 +02:00
Alexander Tokmakov
c083abd40b
Merge pull request #39775 from ClickHouse/fix_subnets_integration_tests 
Fix some flaky integration tests
 2022-08-01 19:59:21 +03:00
Alexey Milovidov
3de747a6e2
Merge pull request #39746 from ClickHouse/cleanup-projection-setting 
Cleanup usages of `allow_experimental_projection_optimization` setting, part 1
 2022-08-01 19:21:30 +03:00
Maksim Kita
31891322a5
Merge pull request #39681 from pkit/pkit/executable_settings 
add settings for executable table func
 2022-08-01 17:59:52 +02:00
fastio
d58df93e96 fix test case code style 2022-08-01 21:40:39 +08:00
Amos Bird
2b2ee8a2c3
Format tests 2022-08-01 21:04:12 +08:00
Amos Bird
2a73ccb3f6
Normalize AggregateFunctionCount type comparison 2022-08-01 21:04:10 +08:00
Ilya Yatsishin
c882bdc88e
Merge pull request #35968 from ClickHouse/interserver_listen_port 2022-08-01 13:57:17 +02:00
robot-clickhouse
65efc0ec98 Automatic style fix 2022-08-01 11:24:03 +00:00
Alexander Tokmakov
38e5e885c3 fix some flaky integration tests 2022-08-01 13:16:12 +02:00
fastio
eecccac2de refine codes and fix test cases 2022-08-01 17:07:30 +08:00
Alexey Milovidov
c5f7a3327b
Merge pull request #39085 from quickhouse/patch-3 
Fixed regexp in `test_match_process_uid_against_data_owner`
 2022-07-31 22:57:26 +03:00
Alexey Milovidov
6a2f7d0c8f
Merge branch 'master' into interserver_listen_port 2022-07-31 22:51:38 +03:00
kssenii
e5f4a619ed Merge master 2022-07-31 20:24:40 +03:00
Robert Schulze
52d08d9db4
Merge pull request #39520 from ClickHouse/no-split-binary 
Remove SPLIT_BINARY
 2022-07-31 14:23:31 +02:00
robot-clickhouse
0b1554c2e7 Automatic style fix 2022-07-31 09:24:53 +00:00
Antonio Andelic
16a98d8eef Add test for creating snapshot on exit 2022-07-31 09:11:46 +00:00
Alexey Milovidov
7e4fb960cb
Merge branch 'master' into patch-3 2022-07-31 02:20:27 +03:00
Alexey Milovidov
17176212a7
Update test.py 2022-07-31 02:20:08 +03:00
Alexey Milovidov
f80a4c184e
Merge branch 'master' into interserver_listen_port 2022-07-31 01:22:32 +03:00
robot-clickhouse
acb148122d Automatic style fix 2022-07-30 21:49:36 +00:00
Alexey Milovidov
441f2feb49 Cleanup usages of allow_experimental_projection_optimization setting, part 1 2022-07-30 23:40:21 +02:00
Constantine Peresypkin
b9d7cd6a5d add settings for executable table func 
SELECT * FROM executable('<script name>', '<format>', '<columns>', (SELECT * FROM table), SETTINGS max_command_execution_time=100, command_termination_timeout=100)

fixes #38908
 2022-07-30 20:02:56 +02:00
Alexander Tokmakov
6f88065cc1 check metadata consistency 2022-07-29 18:33:16 +02:00
Anton Kozlov
ae7fd5bf93 Default database resolution in distributed reads 2022-07-29 13:35:57 +00:00
root
68f825acd4 uncommented formatting tag 2022-07-29 05:09:48 -07:00
root
16c32b8b3f removed True from assert 2022-07-29 00:07:31 -07:00
root
f9e4d6370d modified integration test as suggested 2022-07-28 23:51:59 -07:00
Vitaly Baranov
3b6bacbf0b Add tests. 2022-07-28 22:38:50 +02:00
Robert Schulze
199e254777
Merge remote-tracking branch 'origin/master' into no-split-binary 2022-07-28 15:54:22 +00:00
Alexander Tokmakov
b3732df248 Merge branch 'master' into replicated_database_improvements 2022-07-28 13:08:30 +02:00
Sergei Trifonov
4588e146a6
Merge pull request #37285 from arenadata/ADQM-445 
Add concurrent_threads_soft_limit parameter
 2022-07-28 11:46:43 +02:00
Antonio Andelic
15e999f8bc
Merge pull request #39096 from ClickHouse/keeper-version-check 
Add version for Keeper API
 2022-07-28 10:10:49 +02:00
Roman Vasin
9186b25427 Fix Style Check in test_concurrent_threads_soft_limit 2022-07-28 08:10:44 +00:00
Roman Vasin
f35349eb08 Rename total_max_threads to concurrent_threads_soft_limit 2022-07-28 07:46:20 +00:00
Vitaly Baranov
f8ebe76826
Merge pull request #39503 from vitlibar/improve-system-backups-table 
Improve system.backups table
 2022-07-27 20:25:39 +02:00
Alexander Tokmakov
24725b5f95 fix synchronous queries 2022-07-27 19:15:00 +02:00
Alexander Tokmakov
bcc404bca1
Merge pull request #39084 from quickhouse/patch-2 
Fixed regexp in `test_quota`
 2022-07-27 19:03:19 +03:00
Roman Vasin
8a3125f2d2 Fix integration test test_total_max_threads 2022-07-27 14:34:10 +00:00
Roman Vasin
37845389c8 Merge branch 'concurrency-control' of github.com:ClickHouse/ClickHouse into ADQM-445 2022-07-27 13:31:22 +00:00
Kruglov Pavel
381ea139c2
Merge branch 'master' into schema-inference-cache 2022-07-27 11:35:36 +02:00
Vitaly Baranov
794eeb5d51 Split "total_size" to "uncompressed_size" and "compressed_size". 2022-07-27 10:36:56 +02:00
Vitaly Baranov
a79fc17235 Add test for system.backups 2022-07-27 09:04:10 +02:00
Vitaly Baranov
51a2bf33e8 Rename backup statuses to CREATING_BACKUP, BACKUP_CREATED, BACKUP_FAILED, RESTORING, RESTORED, RESTORE_FAILED. 2022-07-27 09:04:10 +02:00
Vitaly Baranov
fc16a15ecf Rename column "uuid" -> "id" in system.backups and allow user to set it in a query. 2022-07-27 09:04:10 +02:00
Vitaly Baranov
131019ba49 Rename column "backup_name" -> "name" in system.backups. 2022-07-27 09:04:10 +02:00
Vitaly Baranov
16a60b5e93
Merge pull request #39455 from vitlibar/fix-locks-add-tests 
Improve synchronization between hosts in distributed backup and fix locks
 2022-07-27 09:02:58 +02:00
Mikhail f. Shiryaev
3c07684c00
Merge branch 'master' into integration-tests-7 2022-07-26 14:12:37 +02:00
Alexander Tokmakov
bb80ed1dbe
Merge pull request #39564 from ClickHouse/disable_tests_with_materialized_postgres 
Temporarily disable all tests with MaterializedPostgreSQL
 2022-07-26 14:56:48 +03:00
alesapin
8e98b7d47d
Merge pull request #39321 from ClickHouse/fix-flaky-keeper-recovery-test 
Possible fix for flaky `test_keeper_force_recovery`
 2022-07-26 13:37:41 +02:00
Roman Vasin
ac2a42cfb0 Fix test 00189_time_zones_long and integration test test_materialized_mysql_database 2022-07-26 10:44:58 +00:00
Kruglov Pavel
53159db782
Merge branch 'master' into numbers-schema-inference 2022-07-26 12:32:49 +02:00
Roman Vasin
9607b21e73 Fix integration test test_timezone_config 2022-07-26 09:00:46 +00:00
fastio
4fdd0c37a5 fix test case format 2022-07-26 15:05:50 +08:00
Vitaly Baranov
4c98a7bc0f Add test for Ordinary database. 2022-07-26 08:46:51 +02:00
Alexander Tokmakov
9ffaf2fef2 temporarily disable all tests with materialized postgres 2022-07-25 17:32:51 +02:00
Mallik Hassan
b45e44b7e7
Merge branch 'ClickHouse:master' into Structured-Logging-Support 2022-07-25 12:10:41 -03:00
Yatsishin Ilya
633b628e15 fix after conflict 2022-07-25 12:35:34 +00:00
fastio
7b4c90784e format test case codes 2022-07-25 20:06:52 +08:00
fastio
8210e8c58c fix test cases 2022-07-25 17:46:55 +08:00
Yatsishin Ilya
25db71a8a3 Merge remote-tracking branch 'origin/master' into integration-tests-7 2022-07-25 09:17:55 +00:00
Alexey Milovidov
071374b152 Remove SPLIT_BINARY 2022-07-24 01:15:54 +02:00
Vitaly Baranov
6174fe1d72 Fix tests. 2022-07-22 18:33:46 +02:00
Alexander Tokmakov
39ba920cb6 Merge branch 'master' into replicated_database_improvements 2022-07-22 13:38:26 +02:00
Antonio Andelic
3040ff0959 Merge branch 'master' into keeper-version-check 2022-07-22 08:07:55 +00:00
Dan Roscigno
948f207e46
nats-py is missing also 2022-07-21 22:47:40 -04:00
Dan Roscigno
6d289cf9a5
Update README.md 2022-07-21 18:18:14 -04:00
Alexander Tokmakov
df39af23a1 fix 2022-07-21 20:32:33 +02:00
Vitaly Baranov
36d3923622 Add one more concurrency test. 2022-07-21 20:31:43 +02:00
Alexander Tokmakov
0441d3629e
Merge pull request #39440 from liangliangpan/optimize-cluster-table-func 
optimize select query from cluster table function
 2022-07-21 20:40:31 +03:00
Kruglov Pavel
9252f42b4c
Merge branch 'master' into schema-inference-cache 2022-07-21 18:59:14 +02:00
avogar
02c90fd94b Fix tests 2022-07-21 16:54:42 +00:00
Alexander Tokmakov
9e9969cea7
Merge pull request #37827 from arthurpassos/host_regexp_multiple_domains 
Test host_regexp against all PTR records instead of only one
 2022-07-21 16:43:05 +03:00
Alexander Tokmakov
f79f12408d fixes 2022-07-21 13:57:24 +02:00
Arthur Passos
03bd7ce7b8 Minor style fix in dns integ test 2022-07-21 08:29:40 -03:00
Vitaly Baranov
708d0eb34c Add concurrent tests for backups. 2022-07-21 12:02:18 +02:00
Vitaly Baranov
619e22fe57 Add tests for shutdown during backup. 2022-07-21 12:01:16 +02:00
fastio
f382a91d54 Auto optimize partition in background if enabled 2022-07-21 10:49:09 +08:00
Nikolai Kochetov
6028f7909b Fixing build. 2022-07-20 20:45:29 +00:00
Arthur Passos
8b49952c7a remove custom debugging log 2022-07-20 14:21:06 -03:00
Arthur Passos
29613f4277 remove unused coredns symbols 2022-07-20 14:20:28 -03:00
Arthur Passos
828de2a674 Add host regexp multiple PTR records integration tests 2022-07-20 14:09:38 -03:00
Kruglov Pavel
3046cd6d29
Merge branch 'master' into schema-inference-cache 2022-07-20 13:30:42 +02:00
Alexander Tokmakov
e295fd5090 Merge branch 'master' into replicated_database_improvements 2022-07-20 12:49:18 +02:00
Vitaly Baranov
a3cd9dc923 Fix flaky test test_login_as_dropped_user_xml. 2022-07-20 12:47:48 +02:00
Antonio Andelic
179d04518a Black 2022-07-20 08:10:52 +00:00
Antonio Andelic
84ef2c9a1f Fix integration tests 2022-07-20 07:55:19 +00:00
Nikolai Kochetov
dd1349e2d4 Fix test. 2022-07-19 16:20:59 +00:00
kssenii
21ebf8874e Merge remote-tracking branch 'upstream/master' into make-cache-composable 2022-07-19 13:36:42 +02:00
Nikolai Kochetov
fc6982f9e2 Fixing test. 2022-07-19 10:10:02 +00:00
Antonio Andelic
de2a0ca05e black 2022-07-19 09:03:58 +00:00
Vitaly Baranov
6b03f200e4
Merge pull request #39322 from vitlibar/auto-set-test-name-in-integration-tests 
Auto set test name in integration tests
 2022-07-19 10:44:38 +02:00
Vladimir Chebotaryov
5d3028741c Fixed regexp in test_quota. 2022-07-19 06:43:24 +03:00
Vladimir Chebotaryov
39edbeba35 Fixed regexp in test_match_process_uid_against_data_owner. 2022-07-19 06:43:00 +03:00
Vitaly Baranov
725ad5bf22
Update cluster.py 2022-07-18 20:49:30 +02:00
Alexander Tokmakov
ffc50fe6ab
Merge pull request #39334 from ClickHouse/try_fix_flaky_test_store_cleanup 
Try fix flaky test_store_cleanup
 2022-07-18 21:44:40 +03:00
Alexander Tokmakov
225a5c3c7e
Update tests/integration/helpers/cluster.py 2022-07-18 18:19:02 +03:00
kssenii
0aed5a602a Merge master 2022-07-18 16:16:28 +02:00
kssenii
274457e5cf Allow cache over azure blob storage, add tests 2022-07-18 16:15:04 +02:00
Alexander Tokmakov
dfccb677f5 try fix flaky test_store_cleanup 2022-07-18 16:03:06 +02:00
Vitaly Baranov
ad115a9a3d
Merge pull request #39254 from vitlibar/backup-checks-destination-not-in-use 
Check that the destination for a backup is not in use.
 2022-07-18 15:19:43 +02:00
Vitaly Baranov
e67a447fc3 Fix style. 2022-07-18 15:17:53 +02:00
Vitaly Baranov
bd563c210e Update tests/integration/helpers/cluster.py 
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
 2022-07-18 15:04:03 +02:00
Vitaly Baranov
15882b1d86 Auto set test's name in integration tests. 2022-07-18 15:03:57 +02:00
kssenii
a6655bea1c Some fixes 2022-07-18 14:23:08 +02:00
Antonio Andelic
cc1046f18a Possible fix for flaky test_keeper_force_recovery 2022-07-18 12:12:24 +00:00
Vitaly Baranov
74a0f67676 Fix setting name in integration tests. 2022-07-18 13:46:26 +02:00
Kseniia Sumarokova
5022eace6e
Merge pull request #39283 from kssenii/fixe-postgres-fetch-tables 
Fix incorrect postgresql query which fetches tables list
 2022-07-18 12:00:08 +02:00
Yatsishin Ilya
2194f1aa5d Merge remote-tracking branch 'qoega/integration-tests-7' into integration-tests-7 2022-07-18 09:34:48 +00:00
Yatsishin Ilya
d243b5c785 remove unnecessary try-except 2022-07-18 09:32:19 +00:00
Yatsishin Ilya
e5b0c85f8c improve test_rabbitmq_drop_mv: it was flaky and waited 900 second timeout 2022-07-18 09:30:43 +00:00
Yatsishin Ilya
eb2da901c7 Merge remote-tracking branch 'origin/master' into integration-tests-7 2022-07-18 09:29:35 +00:00
kssenii
8ad26b3111 Merge master 2022-07-16 22:50:03 +02:00
Vitaly Baranov
e0fb03d1b6
Merge pull request #38970 from vitlibar/select-from-system-db-requires-grant 
SELECT from the system database requires grant now
 2022-07-16 22:37:47 +02:00
alesapin
afd5c40335
Merge pull request #39190 from ClickHouse/fix_race_with_concurrent_hardlinks 
Fix extremely rare race condition in hardlinks creation
 2022-07-16 13:57:02 +02:00
kssenii
9bba55110c Fix 2022-07-16 12:44:47 +02:00
root
03194eaeb9 Feature - Structured Logging Support resubmit 2022-07-15 10:01:30 -07:00
alesapin
ec15be2798 Add missed file 2022-07-15 19:00:50 +02:00
Alexander Tokmakov
17bc6f1db9 fix tests 2022-07-15 18:11:14 +02:00
alesapin
9eb7553fce
Update tests/integration/helpers/cluster.py 2022-07-15 18:03:24 +02:00
alesapin
39d61e9a37
Merge pull request #39064 from quickhouse/patch-1 
More stable `test_s3_zero_copy_ttl`, weakened requirement to move data to S3 in 0-5 seconds
 2022-07-15 17:58:58 +02:00
Alexander Tokmakov
ae16555aa4 Merge branch 'master' into replicated_database_improvements 2022-07-15 15:50:23 +02:00
Vitaly Baranov
5691a859d6 Add tests. 2022-07-15 15:44:29 +02:00
Vitaly Baranov
ef3a24d20f Fix tests. 2022-07-15 15:44:29 +02:00
Vitaly Baranov
6bf7bffbeb Correct the list of always accessible system tables. 2022-07-15 15:44:29 +02:00
Vitaly Baranov
fbb2e14d54 Add new table function viewIfPermitted(). 2022-07-15 15:44:29 +02:00
Vitaly Baranov
c85b2b5732 Add option enabling that SELECT from the system database requires grant. 2022-07-15 15:44:25 +02:00
alesapin
6c5de5a867 FIX BLACK 2022-07-15 15:34:44 +02:00
alesapin
cb6bc63af1 Better test 2022-07-15 14:43:27 +02:00
Vitaly Baranov
2f47be5da7 Check that the destination for a backup is not in use. 2022-07-15 13:34:58 +02:00
Alexander Tokmakov
c4cbefb521
Update test.py 2022-07-15 13:44:37 +03:00
alesapin
8d07a1427f
Update storage_conf.xml 2022-07-15 12:28:56 +02:00
alesapin
d4a24a5f8e Better test 2022-07-15 00:50:03 +02:00
alesapin
687961cf42 Fix style 2022-07-15 00:38:58 +02:00
alesapin
c7da3d61bf More stressful test 2022-07-15 00:32:20 +02:00
kssenii
15a2d60f23 Fix checks 2022-07-14 22:04:39 +02:00
alesapin
1bc943264c Add concurrent backups test 2022-07-14 21:38:17 +02:00
kssenii
31f0abe672 Test cache over WebObjectStorage 2022-07-14 15:48:07 +02:00
kssenii
5459644a37 Fix checks 2022-07-14 12:52:30 +02:00
Kruglov Pavel
b38241b08a
Merge branch 'master' into schema-inference-cache 2022-07-14 12:29:54 +02:00
Kseniia Sumarokova
530dac6487
Merge pull request #37213 from aaapetrenko/master 
add TableFunctionMongoDB and tests
 2022-07-14 12:09:07 +02:00
Kseniia Sumarokova
b4321904bf
Update test.py 2022-07-13 22:59:14 +02:00
Kseniia Sumarokova
61ce5161f3
Merge pull request #39106 from kssenii/cache-cacth-disk-full-on-cache-write 
fs cache: continue without exception when getting no disk space left error
 2022-07-13 19:08:13 +02:00
Kseniia Sumarokova
765503cd61
Update test.py 2022-07-13 17:55:24 +02:00
Kseniia Sumarokova
48cb1ed909
Update test.py 2022-07-13 11:48:39 +02:00
kssenii
ae324622d3 Add one more test 2022-07-13 11:27:43 +02:00
Nikolai Kochetov
df18d6a416 Fix style 2022-07-12 18:12:59 +00:00
Robert Schulze
8b6e31cc61
Merge pull request #37882 from excitoon-favorites/nodeleteobjects 
Fixes for objects removal in `S3ObjectStorage`
 2022-07-12 19:09:55 +02:00