mirror of
https://github.com/ClickHouse/ClickHouse.git
synced 2024-11-19 14:11:58 +00:00
e8a5804e76
* update presentations * CLICKHOUSE-2936: redirect from clickhouse.yandex.ru and clickhouse.yandex.com * update submodule * lost files * CLICKHOUSE-2981: prefer sphinx docs over original reference * CLICKHOUSE-2981: docs styles more similar to main website + add flags to switch language links * update presentations * Less confusing directory structure (docs -> doc/reference/) * Minify sphinx docs too * Website release script: fail fast + pass docker hash on deploy * Do not underline links in docs * shorter * cleanup docker images * tune nginx config * CLICKHOUSE-3043: get rid of habrastorage links * Lost translation * CLICKHOUSE-2936: temporary client-side redirect * behaves weird in test * put redirect back * CLICKHOUSE-3047: copy docs txts to public too * move to proper file * remove old pages to avoid confusion * Remove reference redirect warning for now * Refresh README.md * Yellow buttons in docs * Use svg flags instead of unicode ones in docs * fix test website instance * Put flags to separate files * wrong flag * Copy Yandex.Metrica introduction from main page to docs * Yet another home page structure change, couple new blocks (CLICKHOUSE-3045) * Update Contacts section * CLICKHOUSE-2849: more detailed legal information * CLICKHOUSE-2978 preparation - split by files * More changes in Contacts block * Tune texts on index page * update presentations * One more benchmark * Add usage sections to index page, adapted from slides * Get the roadmap started, based on slides from last ClickHouse Meetup * CLICKHOUSE-2977: some rendering tuning * Get rid of excessive section in the end of getting started * Make headers linkable * CLICKHOUSE-2981: links to editing reference - https://github.com/yandex/ClickHouse/issues/849 * CLICKHOUSE-2981: fix mobile styles in docs * Ban crawling of duplicating docs * Open some external links in new tab * Ban old docs too * Lots of trivial fixes in english docs * Lots of trivial fixes in russian docs * Remove getting started copies in markdown * Add Yandex.Webmaster * Fix some sphinx warnings * More warnings fixed in english docs * More sphinx warnings fixed * Add code-block:: text * More code-block:: text * These headers look not that well * Better switch between documentation languages * merge use_case.rst into ya_metrika_task.rst * Edit the agg_functions.rst texts * Add lost empty lines
121 lines
4.7 KiB
ReStructuredText
121 lines
4.7 KiB
ReStructuredText
Functions for working with URLs
|
|
-------------------------------
|
|
|
|
All these functions don't follow the RFC. They are maximally simplified for improved performance.
|
|
|
|
Functions tat extract part of the URL
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
If there isn't anything similar in a URL, an empty string is returned.
|
|
|
|
protocol
|
|
""""""""
|
|
Selects the protocol. Examples: http, ftp, mailto, magnet...
|
|
|
|
domain
|
|
""""""
|
|
Selects the domain.
|
|
|
|
domainWithoutWWW
|
|
""""""""""""""""
|
|
Selects the domain and removes no more than one 'www.' from the beginning of it, if present.
|
|
|
|
topLevelDomain
|
|
""""""""""""""
|
|
Selects the top-level domain. Example: .ru.
|
|
|
|
firstSignificantSubdomain
|
|
"""""""""""""""""""""""""
|
|
Selects the "first significant subdomain". This is a non-standard concept specific to Yandex.Metrica. The first significant subdomain is a second-level domain if it is 'com', 'net', 'org', or 'co'. Otherwise, it is a third-level domain. For example, firstSignificantSubdomain('https://news.yandex.ru/') = 'yandex', firstSignificantSubdomain('https://news.yandex.com.tr/') = 'yandex'. The list of "insignificant" second-level domains and other implementation details may change in the future.
|
|
|
|
cutToFirstSignificantSubdomain
|
|
""""""""""""""""""""""""""""""
|
|
Selects the part of the domain that includes top-level subdomains up to the "first significant subdomain" (see the explanation above).
|
|
|
|
For example, ``cutToFirstSignificantSubdomain('https://news.yandex.com.tr/') = 'yandex.com.tr'``.
|
|
|
|
path
|
|
""""
|
|
Selects the path. Example: /top/news.html The path does not include the query-string.
|
|
|
|
pathFull
|
|
""""""""
|
|
The same as above, but including query-string and fragment. Example: /top/news.html?page=2#comments
|
|
|
|
queryString
|
|
"""""""""""
|
|
Selects the query-string. Example: page=1&lr=213. query-string does not include the first question mark, or # and everything that comes after #.
|
|
|
|
fragment
|
|
""""""""
|
|
Selects the fragment identifier. fragment does not include the first number sign (#).
|
|
|
|
queryStringAndFragment
|
|
""""""""""""""""""""""
|
|
Selects the query-string and fragment identifier. Example: page=1#29390.
|
|
|
|
extractURLParameter(URL, name)
|
|
""""""""""""""""""""""""""""""
|
|
Selects the value of the 'name' parameter in the URL, if present. Otherwise, selects an empty string. If there are many parameters with this name, it returns the first occurrence. This function works under the assumption that the parameter name is encoded in the URL in exactly the same way as in the argument passed.
|
|
|
|
extractURLParameters(URL)
|
|
"""""""""""""""""""""""""
|
|
Gets an array of name=value strings corresponding to the URL parameters. The values are not decoded in any way.
|
|
|
|
extractURLParameterNames(URL)
|
|
"""""""""""""""""""""""""""""
|
|
Gets an array of name=value strings corresponding to the names of URL parameters. The values are not decoded in any way.
|
|
|
|
URLHierarchy(URL)
|
|
"""""""""""""""""
|
|
Gets an array containing the URL trimmed to the ``/``, ``?`` characters in the path and query-string. Consecutive separator characters are counted as one. The cut is made in the position after all the consecutive separator characters. Example:
|
|
|
|
URLPathHierarchy(URL)
|
|
"""""""""""""""""""""
|
|
The same thing, but without the protocol and host in the result. The / element (root) is not included. Example:
|
|
This function is used for implementing tree-view reports by URL in Yandex.Metrica.
|
|
.. code-block:: text
|
|
|
|
URLPathHierarchy('https://example.com/browse/CONV-6788') =
|
|
[
|
|
'/browse/',
|
|
'/browse/CONV-6788'
|
|
]
|
|
|
|
decodeURLComponent(URL)
|
|
"""""""""""""""""""""""
|
|
Returns a URL-decoded URL.
|
|
|
|
Example:
|
|
|
|
.. code-block:: sql
|
|
|
|
SELECT decodeURLComponent('http://127.0.0.1:8123/?query=SELECT%201%3B') AS DecodedURL;
|
|
|
|
┌─DecodedURL─────────────────────────────┐
|
|
│ http://127.0.0.1:8123/?query=SELECT 1; │
|
|
└────────────────────────────────────────┘
|
|
|
|
Functions that remove part of a URL.
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
If the URL doesn't have anything similar, the URL remains unchanged.
|
|
|
|
cutWWW
|
|
""""""
|
|
Removes no more than one 'www.' from the beginning of the URL's domain, if present.
|
|
|
|
cutQueryString
|
|
""""""""""""""
|
|
Removes the query-string. The question mark is also removed..
|
|
|
|
cutFragment
|
|
"""""""""""
|
|
Removes the fragment identifier. The number sign is also removed.
|
|
|
|
cutQueryStringAndFragment
|
|
"""""""""""""""""""""""""
|
|
Removes the query-string and fragment identifier. The question mark and number sign are also removed.
|
|
|
|
cutURLParameter(URL, name)
|
|
""""""""""""""""""""""""""
|
|
Removes the URL parameter named 'name', if present. This function works under the assumption that the parameter name is encoded in the URL exactly the same way as in the passed argument.
|