thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-25 09:02:00 +00:00
Code Issues Packages Projects Releases Wiki Activity

[Docs] Fix style check errors

Browse Source
This commit is contained in:
justindeguzman 2024-06-28 19:32:51 -07:00
parent 20385161e4
commit 0dd4735e07
2 changed files with 13 additions and 8 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

16
docs/en/getting-started/example-datasets/stackoverflow.md
View File

@ -7,19 +7,19 @@ description: Analyzing Stack Overflow data with ClickHouse
# Analyzing Stack Overflow data with ClickHouse # Analyzing Stack Overflow data with ClickHouse
This dataset contains every Post, User, Vote, Comment, Badge, PostHistory, and PostLink that has occurred on Stack Overflow. This dataset contains every `Post`, `User`, `Vote`, `Comment`, `Badge, `PostHistory`, and `PostLink` that has occurred on Stack Overflow.
Users can either download pre-prepared Parquet versions of the data, containing every post up to April 2024, or download the latest data in XML format and load this. Stack Overflow provide updates to this data periodically - historically every 3 months. Users can either download pre-prepared Parquet versions of the data, containing every post up to April 2024, or download the latest data in XML format and load this. Stack Overflow provide updates to this data periodically - historically every 3 months.
The following diagram shows the schema for the available tables assuming Parquet format. The following diagram shows the schema for the available tables assuming Parquet format.
![Stackoverflow schema](./images/stackoverflow.png) ![Stack Overflow schema](./images/stackoverflow.png)
A description of the schema of this data can be found [here](https://meta.stackexchange.com/questions/2677/database-schema-documentation-for-the-public-data-dump-and-sede). A description of the schema of this data can be found [here](https://meta.stackexchange.com/questions/2677/database-schema-documentation-for-the-public-data-dump-and-sede).
## Pre-prepared data ## Pre-prepared data
We provide a copy of this data in Parquet format, upto date as of April 2024. While small for ClickHouse with respect to the number of rows (60 million posts), this dataset contains significant volumes of text and large String columns. We provide a copy of this data in Parquet format, up to date as of April 2024. While small for ClickHouse with respect to the number of rows (60 million posts), this dataset contains significant volumes of text and large String columns.
```sql ```sql
CREATE DATABASE stackoverflow CREATE DATABASE stackoverflow
@ -159,7 +159,7 @@ INSERT INTO stackoverflow.badges SELECT * FROM s3('https://datasets-documentatio
0 rows in set. Elapsed: 6.635 sec. Processed 51.29 million rows, 797.05 MB (7.73 million rows/s., 120.13 MB/s.) 0 rows in set. Elapsed: 6.635 sec. Processed 51.29 million rows, 797.05 MB (7.73 million rows/s., 120.13 MB/s.)
``` ```
### Postlinks ### `PostLinks`
```sql ```sql
CREATE TABLE stackoverflow.postlinks CREATE TABLE stackoverflow.postlinks
@ -178,7 +178,7 @@ INSERT INTO stackoverflow.postlinks SELECT * FROM s3('https://datasets-documenta
0 rows in set. Elapsed: 1.534 sec. Processed 6.55 million rows, 129.70 MB (4.27 million rows/s., 84.57 MB/s.) 0 rows in set. Elapsed: 1.534 sec. Processed 6.55 million rows, 129.70 MB (4.27 million rows/s., 84.57 MB/s.)
``` ```
### PostHistory ### `PostHistory`
```sql ```sql
CREATE TABLE stackoverflow.posthistory CREATE TABLE stackoverflow.posthistory
@ -218,11 +218,11 @@ wget https://archive.org/download/stackexchange/stackoverflow.com-Users.7z
wget https://archive.org/download/stackexchange/stackoverflow.com-Votes.7z wget https://archive.org/download/stackexchange/stackoverflow.com-Votes.7z
``` ```
These files are upto 35GB and can take around 30 mins to download depending on internet connection - the download server throttles at around 20MB/sec. These files are up to 35GB and can take around 30 mins to download depending on internet connection - the download server throttles at around 20MB/sec.
### Convert to JSON ### Convert to JSON
At the time of writing, ClickHouse does not have native support for XML as an input format. To load the data into ClickHouse we first convert to NdJSON. At the time of writing, ClickHouse does not have native support for XML as an input format. To load the data into ClickHouse we first convert to NDJSON.
To convert XML to JSON we recommend the [`xq`](https://github.com/kislyuk/yq) linux tool, a simple `jq` wrapper for XML documents. To convert XML to JSON we recommend the [`xq`](https://github.com/kislyuk/yq) linux tool, a simple `jq` wrapper for XML documents.
@ -301,7 +301,7 @@ Peak memory usage: 224.03 MiB.
### User with the most answers (active accounts) ### User with the most answers (active accounts)
Account requires a UserId. Account requires a `UserId`.
```sql ```sql
SELECT SELECT

5
utils/check-style/aspell-ignore/en/aspell-dict.txt
View File

@ -572,6 +572,7 @@ MySQLDump
MySQLThreads MySQLThreads
NATS NATS
NCHAR NCHAR
NDJSON
NEKUDOTAYIM NEKUDOTAYIM
NEWDATE NEWDATE
NEWDECIMAL NEWDECIMAL
@ -714,6 +715,8 @@ PlantUML
PointDistKm PointDistKm
PointDistM PointDistM
PointDistRads PointDistRads
PostHistory
PostLink
PostgreSQLConnection PostgreSQLConnection
PostgreSQLThreads PostgreSQLThreads
Postgres Postgres
@ -2496,6 +2499,7 @@ sqlite
sqrt sqrt
src src
srcReplicas srcReplicas
stackoverflow
stacktrace stacktrace
stacktraces stacktraces
startsWith startsWith
@ -2834,6 +2838,7 @@ userver
utils utils
uuid uuid
uuidv uuidv
vCPU
varPop varPop
varPopStable varPopStable
varSamp varSamp