Commit Graph

47803 Commits

Author SHA1 Message Date
Vitaly Baranov
dbc837c148 IAccessStorage now can override the login() function. 2020-09-19 01:04:20 +03:00
Azat Khuzhin
a35c1f8ed0 Do not check client's host when user comes from interserver secret 2020-09-16 00:35:49 +03:00
Azat Khuzhin
85b63ecadf Bump revision manually (to make it compatible with other version from this tag)
As @alexey-milovidov wrote.

P.S. I did not use ./utils/release/release_lib.sh (via ./release), since
it is pretty complex (it fetches tags and so on)

The following macros has been updated:
- VERSION_REVISION -- usually bumped with utils/release/release_lib.sh
  (interesting that even if there were no changes)
- DBMS_MIN_REVISION_WITH_INTERSERVER_SECRET
- DBMS_TCP_PROTOCOL_VERSION -- does not affect anything, some internal
  yandex stuff
2020-09-15 01:36:28 +03:00
Azat Khuzhin
3fb548b3bb Cluster: use boost::range::remove_erase() over std::erase (c++20)
@vitlibar:

  "Yandex synchronization check says

  src/Interpreters/Cluster.cpp:299:10: error: no member named 'erase' in namespace 'std'
      std::erase(config_keys, "secret");
      ~~~~~^
  1 error generated.
  Please replace std::erase with boost::range::remove_erase."

  "That's quite an unusual build which links ClickHouse with a lot of closed source code and which still can't use most of C++20 features."
2020-09-15 01:36:28 +03:00
Azat Khuzhin
785d1b2a75 OpenSSLHelpers cleanup
Add few more specializations for encodeSHA256():
- std::string encodeSHA256(const std::string_view &);
- std::string encodeSHA256(const void *, size_t);
- void encodeSHA256(const void *, size_t, unsigned char *);
2020-09-15 01:36:28 +03:00
Azat Khuzhin
0159c74f21 Secure inter-cluster query execution (with initial_user as current query user) [v3]
Add inter-server cluster secret, it is used for Distributed queries
inside cluster, you can configure in the configuration file:

  <remote_servers>
      <logs>
          <shard>
              <secret>foobar</secret> <!-- empty -- works as before -->
              ...
          </shard>
      </logs>
  </remote_servers>

And this will allow clickhouse to make sure that the query was not
faked, and was issued from the node that knows the secret. And since
trust appeared it can use initial_user for query execution, this will
apply correct *_for_user (since with inter-server secret enabled, the
query will be executed from the same user on the shards as on initator,
unlike "default" user w/o it).

v2: Change user to the initial_user for Distributed queries if secret match
v3: Add Protocol::Cluster package
v4: Drop Protocol::Cluster and use plain Protocol::Hello + user marker
v5: Do not use user from Hello for cluster-secure (superfluous)
2020-09-15 01:36:28 +03:00
Azat Khuzhin
ec9d7745f3 Break the query loop on UNEXPECTED_PACKET_FROM_CLIENT 2020-09-15 01:36:28 +03:00
Azat Khuzhin
d53bbd3394 Not only send the exception to the client but also log it
Otherwise there will be only tricky "Unknown packet" exception after
exception during handling INSERT queries.
2020-09-15 01:36:28 +03:00
Azat Khuzhin
2fce2b21a8 Use pytest.raises(match=) in test_allowed_client_hosts
Since pytest.raises() produces excinfo not exception, hence at least
str(excinfo.value) should be used to match the exception message.
2020-09-15 01:36:28 +03:00
Azat Khuzhin
65e48663e7 Drop policy on start in 01308_row_policy_and_trivial_count_query 2020-09-15 01:36:22 +03:00
Alexey Milovidov
7aa3f86ab9 Added config.d file for development 2020-09-14 22:44:20 +03:00
alexey-milovidov
6b6658d4e1
Merge pull request #14744 from Vxider/translation_remote
Improve Chinese translation of remote.md
2020-09-14 22:32:06 +03:00
alexey-milovidov
4b79927825
Merge pull request #14803 from ClickHouse/filimonov-patch-1
Update clickhouse-benchmark.md
2020-09-14 22:20:57 +03:00
alesapin
58f4e5f967
Merge pull request #14755 from vitlibar/fix-permission-denied-in-integration-tests
Fix access denied on opening file /var/lib/clickhouse/status in integration tests.
2020-09-14 22:08:21 +03:00
alexey-milovidov
e7393ab38b
Merge pull request #14718 from ClickHouse/aku/20.8-changelog
changelog for 20.8
2020-09-14 21:58:18 +03:00
alexey-milovidov
493b9b696e
Update CHANGELOG.md 2020-09-14 21:57:50 +03:00
alexey-milovidov
bca73a75c6
Update CHANGELOG.md 2020-09-14 21:49:45 +03:00
alexey-milovidov
f23798879e
Update CHANGELOG.md 2020-09-14 21:42:50 +03:00
Nikolai Kochetov
d418ee48a4
Merge pull request #14783 from amosbird/fix3
Fix signedness conversion monotonicity
2020-09-14 21:40:51 +03:00
Nikita Mikhaylov
ddea62211d
Merge pull request #11948 from CurtizJ/fsync-parts
Experiment. Allow to turn on fsync on inserts, merges and fetches.
2020-09-14 22:37:14 +04:00
alexey-milovidov
2e13e8e836
Update CHANGELOG.md 2020-09-14 21:19:30 +03:00
Alexey Milovidov
038ae02126 Fix for #14761, part 2 2020-09-14 20:24:55 +03:00
Alexander Kuzmenkov
9e3797b252
Merge pull request #14710 from ClickHouse/aku/faster-perf
Do less runs in perf test
2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov
b3138605c7 performance comparison 2020-09-14 19:16:59 +03:00
Ildus Kurbangaliev
67b49862d9
Add mapPopulateSeries function (#13166) 2020-09-14 19:11:50 +03:00
Ivan Blinkov
fae21d7d09
Update event links 2020-09-14 18:27:15 +03:00
Alexey Milovidov
b5620018ca Fix for #14761 2020-09-14 17:02:24 +03:00
alexey-milovidov
9d9b579291
Update CHANGELOG.md 2020-09-14 16:48:18 +03:00
Vitaly Baranov
cae5a23a43
Merge pull request #13837 from vitlibar/add-user-directories-section-to-default-config
Add the section <user_directories> to the default config.
2020-09-14 16:47:32 +03:00
alexey-milovidov
752e3f8197
Merge pull request #14453 from amosbird/apply2
column transformers in insert select
2020-09-14 16:46:01 +03:00
alexey-milovidov
882206c0b6
Update InterpreterInsertQuery.cpp 2020-09-14 16:45:32 +03:00
alexey-milovidov
e464eadc53
Merge pull request #14670 from azat/gcc-sanitizers
Pass -fsanitize-blacklist for TSAN only under clang (gcc does not support this)
2020-09-14 16:38:49 +03:00
alexey-milovidov
782c010cfd
Merge pull request #14668 from azat/list-licenses.sh-more-excludes
utils/list-licenses/list-licenses.sh: ignore more files
2020-09-14 16:37:43 +03:00
filimonov
709b0f138a
Update clickhouse-benchmark.md 2020-09-14 14:55:40 +02:00
Artem Zuikov
d274125c74
Fix wide integer left shift + refactoring (#14697) 2020-09-14 14:56:43 +03:00
Amos Bird
654245af3c
Fix signedness conversion monotonicity 2020-09-14 18:11:40 +08:00
Alexander Kuzmenkov
3113aa6cfe Avoid extra error in perf report on broken queries 2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov
c701a15271 fixup 2020-09-14 10:27:46 +03:00
Alexander Kuzmenkov
30bc5e19b7 Merge remote-tracking branch 'origin/master' into aku/faster-perf 2020-09-14 10:18:28 +03:00
alesapin
0c04f4d008
Update cluster.py 2020-09-14 10:01:20 +03:00
alesapin
06575970aa
Merge pull request #14705 from amosbird/misc1
Add merge_algorithm to system.merges
2020-09-14 09:58:30 +03:00
alesapin
336430d3c2
Merge pull request #14646 from ClickHouse/if_bug
Fix bug in if function when then clause contain const nullable column
2020-09-14 09:51:40 +03:00
rodrigargar
3e00d64ebf
Update backup.md (#14702)
* Update backup.md

Fix most of the first paragraph that was left untranslated and other minor fixes.

* Update backup.md

Co-authored-by: Ivan Blinkov <github@blinkov.ru>
2020-09-14 08:17:23 +03:00
Denis Zhuravlev
d8a7fd2428
view.md sync russian doc with eng. (#14779) 2020-09-14 08:15:54 +03:00
Denis Zhuravlev
631fa3a28b
drop.md sync russian doc. with eng. (#14780) 2020-09-14 08:14:53 +03:00
Vxider
f2293d5d17 update translation 2020-09-14 12:29:25 +08:00
Nikolai Kochetov
109fd9d6d7
Merge pull request #13015 from amosbird/jgmko
Refactor joinGet and implement multi-key lookup.
2020-09-13 22:39:48 +03:00
Amos Bird
016f707ea1
column transformers in insert select 2020-09-13 10:21:13 +08:00
Amos Bird
c2d79bc5cc
Add merge_algorithm to system.merges 2020-09-13 10:00:03 +08:00
Vitaly Baranov
421eeeccef Add the section user_directories to the default config. 2020-09-12 23:04:28 +03:00