Commit Graph

48013 Commits

Author SHA1 Message Date
bharatnc
90e0ef9b70 QueryLog,QueryThreadLOg - better test for query_start_time_microseconds 2020-09-14 20:04:29 -07:00
bharatnc
e4e3105014 Construct query_start_time(_microseconds) from same timespec 2020-09-14 20:04:16 -07:00
Amos Bird
4770175aa3
more tests 2020-09-15 10:02:26 +08:00
Nikolai Kochetov
95ae1105d9 Remove virtual destructors for Visitor. 2020-09-15 02:05:43 +03:00
Vitaly Baranov
0f53b449fd Add 'params' column to system.user_directories table. 2020-09-15 01:51:53 +03:00
Azat Khuzhin
85b63ecadf Bump revision manually (to make it compatible with other version from this tag)
As @alexey-milovidov wrote.

P.S. I did not use ./utils/release/release_lib.sh (via ./release), since
it is pretty complex (it fetches tags and so on)

The following macros has been updated:
- VERSION_REVISION -- usually bumped with utils/release/release_lib.sh
  (interesting that even if there were no changes)
- DBMS_MIN_REVISION_WITH_INTERSERVER_SECRET
- DBMS_TCP_PROTOCOL_VERSION -- does not affect anything, some internal
  yandex stuff
2020-09-15 01:36:28 +03:00
Azat Khuzhin
3fb548b3bb Cluster: use boost::range::remove_erase() over std::erase (c++20)
@vitlibar:

  "Yandex synchronization check says

  src/Interpreters/Cluster.cpp:299:10: error: no member named 'erase' in namespace 'std'
      std::erase(config_keys, "secret");
      ~~~~~^
  1 error generated.
  Please replace std::erase with boost::range::remove_erase."

  "That's quite an unusual build which links ClickHouse with a lot of closed source code and which still can't use most of C++20 features."
2020-09-15 01:36:28 +03:00
Azat Khuzhin
785d1b2a75 OpenSSLHelpers cleanup
Add few more specializations for encodeSHA256():
- std::string encodeSHA256(const std::string_view &);
- std::string encodeSHA256(const void *, size_t);
- void encodeSHA256(const void *, size_t, unsigned char *);
2020-09-15 01:36:28 +03:00
Azat Khuzhin
0159c74f21 Secure inter-cluster query execution (with initial_user as current query user) [v3]
Add inter-server cluster secret, it is used for Distributed queries
inside cluster, you can configure in the configuration file:

  <remote_servers>
      <logs>
          <shard>
              <secret>foobar</secret> <!-- empty -- works as before -->
              ...
          </shard>
      </logs>
  </remote_servers>

And this will allow clickhouse to make sure that the query was not
faked, and was issued from the node that knows the secret. And since
trust appeared it can use initial_user for query execution, this will
apply correct *_for_user (since with inter-server secret enabled, the
query will be executed from the same user on the shards as on initator,
unlike "default" user w/o it).

v2: Change user to the initial_user for Distributed queries if secret match
v3: Add Protocol::Cluster package
v4: Drop Protocol::Cluster and use plain Protocol::Hello + user marker
v5: Do not use user from Hello for cluster-secure (superfluous)
2020-09-15 01:36:28 +03:00
Azat Khuzhin
ec9d7745f3 Break the query loop on UNEXPECTED_PACKET_FROM_CLIENT 2020-09-15 01:36:28 +03:00
Azat Khuzhin
d53bbd3394 Not only send the exception to the client but also log it
Otherwise there will be only tricky "Unknown packet" exception after
exception during handling INSERT queries.
2020-09-15 01:36:28 +03:00
Azat Khuzhin
2fce2b21a8 Use pytest.raises(match=) in test_allowed_client_hosts
Since pytest.raises() produces excinfo not exception, hence at least
str(excinfo.value) should be used to match the exception message.
2020-09-15 01:36:28 +03:00
Azat Khuzhin
65e48663e7 Drop policy on start in 01308_row_policy_and_trivial_count_query 2020-09-15 01:36:22 +03:00
Nikolai Kochetov
65a1057aae Revert "Try simplify Visitor."
This reverts commit 9fcfa560ae.
2020-09-15 00:40:41 +03:00
Nikolai Kochetov
31660ddb4d Fix build 2020-09-15 00:30:55 +03:00
Nikolai Kochetov
1b618fd130 Fix build 2020-09-14 23:56:56 +03:00
Nikolai Kochetov
9fcfa560ae Try simplify Visitor. 2020-09-14 23:35:45 +03:00
Nikolai Kochetov
45098f7112 Fix build. 2020-09-14 23:32:38 +03:00
Alexander Tokmakov
da6beb1a91 Merge branch 'master' into enable_some_tests_with_database_atomic 2020-09-14 23:00:14 +03:00
Nikolai Kochetov
d09422e60f Fix build. 2020-09-14 22:49:46 +03:00
Vladimir Golovchenko
adbd240417 Added missed section S011 according to SQL:2011. 2020-09-14 12:45:51 -07:00
Vladimir Golovchenko
eb0c1714fe Extended section E081 according to SQL:2011. 2020-09-14 12:45:51 -07:00
Vladimir Golovchenko
14393a3329 Fixed the wrong version of SQL standard. 2020-09-14 12:45:09 -07:00
Alexey Milovidov
7aa3f86ab9 Added config.d file for development 2020-09-14 22:44:20 +03:00
alexey-milovidov
6b6658d4e1
Merge pull request #14744 from Vxider/translation_remote
Improve Chinese translation of remote.md
2020-09-14 22:32:06 +03:00
alexey-milovidov
4b79927825
Merge pull request #14803 from ClickHouse/filimonov-patch-1
Update clickhouse-benchmark.md
2020-09-14 22:20:57 +03:00
alesapin
e96256d367 Trying to improve performance 2020-09-14 22:15:25 +03:00
alesapin
58f4e5f967
Merge pull request #14755 from vitlibar/fix-permission-denied-in-integration-tests
Fix access denied on opening file /var/lib/clickhouse/status in integration tests.
2020-09-14 22:08:21 +03:00
alexey-milovidov
e7393ab38b
Merge pull request #14718 from ClickHouse/aku/20.8-changelog
changelog for 20.8
2020-09-14 21:58:18 +03:00
alexey-milovidov
493b9b696e
Update CHANGELOG.md 2020-09-14 21:57:50 +03:00
alexey-milovidov
bca73a75c6
Update CHANGELOG.md 2020-09-14 21:49:45 +03:00
alexey-milovidov
f23798879e
Update CHANGELOG.md 2020-09-14 21:42:50 +03:00
Nikolai Kochetov
d418ee48a4
Merge pull request #14783 from amosbird/fix3
Fix signedness conversion monotonicity
2020-09-14 21:40:51 +03:00
Nikita Mikhaylov
ddea62211d
Merge pull request #11948 from CurtizJ/fsync-parts
Experiment. Allow to turn on fsync on inserts, merges and fetches.
2020-09-14 22:37:14 +04:00
alexey-milovidov
2e13e8e836
Update CHANGELOG.md 2020-09-14 21:19:30 +03:00
Alexey Milovidov
b87c108246 Enable remap in performance tests 2020-09-14 21:14:28 +03:00
Alexey Milovidov
3530f83c01 Remove debug output 2020-09-14 21:12:09 +03:00
Alexey Milovidov
2ac88ab47d Added config option 2020-09-14 21:08:09 +03:00
Alexey Milovidov
f9361acb88 Disable in shared libraries mode 2020-09-14 21:00:45 +03:00
Alexey Milovidov
0e73b8acf3 Merge branch 'master' into remap-executable 2020-09-14 20:26:16 +03:00
Alexey Milovidov
038ae02126 Fix for #14761, part 2 2020-09-14 20:24:55 +03:00
Nikolai Kochetov
d4542a352c GatherUtils visibility. 2020-09-14 19:40:04 +03:00
Nikolai Kochetov
08d4e96529 GatherUtils visibility. 2020-09-14 19:37:35 +03:00
Alexander Kuzmenkov
9e3797b252
Merge pull request #14710 from ClickHouse/aku/faster-perf
Do less runs in perf test
2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov
b3138605c7 performance comparison 2020-09-14 19:16:59 +03:00
Ildus Kurbangaliev
67b49862d9
Add mapPopulateSeries function (#13166) 2020-09-14 19:11:50 +03:00
yulu86
17a04cd62b Optimize Chinese tutorial to make it more human readable 2020-09-15 00:01:37 +08:00
Ivan Blinkov
fae21d7d09
Update event links 2020-09-14 18:27:15 +03:00
Nikolai Kochetov
c05021abc7 Inline GatherUtils algorithms. 2020-09-14 18:11:15 +03:00
Nikolai Kochetov
d2cd2775eb Inline GatherUtils algorithms. 2020-09-14 17:44:08 +03:00