With this new layout, sparsehash will be used over default HashMap,
sparsehash is more memory efficient but it is also slower.
So in a nutshell:
- HashMap uses ~2x more memory then sparse_hash_map
- HashMap ~2-2.5x faster then sparse_hash_map
(tested on lots of input, and the most close to production was
dictionary with 600KK hashes and UInt16 as value)
TODO:
- fix allocated memory calculation
- getBufferSizeInBytes/getBufferSizeInCells interface
- benchmarks
v0: replace HashMap with google::sparse_hash_map
v2: use google::sparse_hash_map only when <sparse> isset to true
v3: replace attributes with different layout
v4: use ch hash over std::hash
* CLICKHOUSE-4063: less manual html @ index.md
* CLICKHOUSE-4063: recommend markdown="1" in README.md
* CLICKHOUSE-4003: manually purge custom.css for now
* CLICKHOUSE-4064: expand <details> before any print (including to pdf)
* CLICKHOUSE-3927: rearrange interfaces/formats.md a bit
* CLICKHOUSE-3306: add few http headers
* Remove copy-paste introduced in #3392
* Hopefully better chinese fonts #3392
* get rid of tabs @ custom.css
* Apply comments and patch from #3384
* Add jdbc.md to ToC and some translation, though it still looks badly incomplete
* minor punctuation
* Add some backlinks to official website from mirrors that just blindly take markdown sources
* Do not make fonts extra light
* find . -name '*.md' -type f | xargs -I{} perl -pi -e 's//g' {}
* find . -name '*.md' -type f | xargs -I{} perl -pi -e 's/ sql/g' {}
* Remove outdated stuff from roadmap.md
* Not so light font on front page too
* Refactor Chinese formats.md to match recent changes in other languages
* Update some links on front page
* Remove some outdated comment
* Add twitter link to front page
* More front page links tuning
* Add Amsterdam meetup link
* Smaller font to avoid second line
* Add Amsterdam link to README.md
* Proper docs nav translation
* Back to 300 font-weight except Chinese
* fix docs build
* Update Amsterdam link
* remove symlinks
* more zh punctuation
* apply lost comment by @zhang2014
* Apply comments by @zhang2014 from #3417
* Remove Beijing link
* rm incorrect symlink
* restore content of docs/zh/operations/table_engines/index.md
* CLICKHOUSE-3751: stem terms while searching docs
* CLICKHOUSE-3751: use English stemmer in non-English docs too
* CLICKHOUSE-4135 fix
* Remove past meetup link
* Add blog link to top nav
* Add ContentSquare article link
* Add form link to front page + refactor some texts
* couple markup fixes
* minor
* Introduce basic ODBC driver page in docs
* More verbose 3rd party libs disclaimer
* Put third-party stuff into a separate folder
* Separate third-party stuff in ToC too
* Update links
* Move stuff that is not really (only) a client library into a separate page
* Add clickhouse-hdfs-loader link
* Some introduction for "interfaces" section
* Rewrite tcp.md
* http_interface.md -> http.md
* fix link
* Remove unconvenient error for now
* try to guess anchor instead of failing
* remove symlink
* Remove outdated info from introduction
* remove ru roadmap.md
* replace ru roadmap.md with symlink
* Update roadmap.md
* lost file
* Title case in toc_en.yml
* Sync "Functions" ToC section with en
* Remove reference to pretty old ClickHouse release from docs
* couple lost symlinks in fa
* Close quote in proper place
* Rewrite en/getting_started/index.md
* Sync en<>ru getting_started/index.md
* minor changes
* Some gui.md refactoring
* Translate DataGrip section to ru
* Translate DataGrip section to zh
* Translate DataGrip section to fa
* Translate DBeaver section to fa
* Translate DBeaver section to zh
* Split third-party GUI to open-source and commercial
* Mention some RDBMS integrations + ad-hoc translation fixes
* Add rel="external nofollow" to outgoing links from docs
* Lost blank lines
* Fix class name
* More rel="external nofollow"
* Apply suggestions by @sundy-li
* Mobile version of front page improvements
* test
* test 2
* test 3
* Update LICENSE
* minor docs fix
* Highlight current article as suggested by @sundy-li
* fix link destination
* Introduce backup.md (only "en" for now)
* Mention INSERT+SELECT in backup.md
* Some improvements for replication.md
* Add backup.md to toc
* Mention clickhouse-backup tool
* Mention LightHouse in third-party GUI list
* Introduce interfaces/third-party/proxy.md
* Add clickhouse-bulk to proxy.md
* Major extension of integrations.md contents
* fix link target
* remove unneeded file
* better toc item name
* fix markdown
* better ru punctuation
* Add yet another possible backup approach
* Simplify copying permalinks to headers
* Support non-eng link anchors in docs + update some deps
* Generate anchors for single-page mode automatically
* Remove anchors to top of pages
* Remove anchors that nobody links to
* build fixes
* fix few links
* restore css
* fix some links
* restore gifs
* fix lost words
* more docs fixes
* docs fixes
* NULL anchor
* update urllib3 dependency
* more fixes
* Remove excessive content from print version
* Try short license again
* Back to long license for now
* Introduce anchor integrity checks for single-page docs
* Add --save-raw-single-page option to build.py (helps to debug incorrect anchors)
* fix kafka engine links
* fix one class of broken anchors
* fix some broken links
* Add https://github.com/hatarist/clickhouse-cli to third-party section (in gui.md for now, maybe will add cli.md later)
* fix one more class of links to nowhere
* less duplicate anchors
* get rid of weird anchors
* fix anchor
* fix link
* fix couple links
* CLICKHOUSE-4063: less manual html @ index.md
* CLICKHOUSE-4063: recommend markdown="1" in README.md
* CLICKHOUSE-4003: manually purge custom.css for now
* CLICKHOUSE-4064: expand <details> before any print (including to pdf)
* CLICKHOUSE-3927: rearrange interfaces/formats.md a bit
* CLICKHOUSE-3306: add few http headers
* Remove copy-paste introduced in #3392
* Hopefully better chinese fonts #3392
* get rid of tabs @ custom.css
* Apply comments and patch from #3384
* Add jdbc.md to ToC and some translation, though it still looks badly incomplete
* minor punctuation
* Add some backlinks to official website from mirrors that just blindly take markdown sources
* Do not make fonts extra light
* find . -name '*.md' -type f | xargs -I{} perl -pi -e 's//g' {}
* find . -name '*.md' -type f | xargs -I{} perl -pi -e 's/ sql/g' {}
* Remove outdated stuff from roadmap.md
* Not so light font on front page too
* Refactor Chinese formats.md to match recent changes in other languages
* Update some links on front page
* Remove some outdated comment
* Add twitter link to front page
* More front page links tuning
* Add Amsterdam meetup link
* Smaller font to avoid second line
* Add Amsterdam link to README.md
* Proper docs nav translation
* Back to 300 font-weight except Chinese
* fix docs build
* Update Amsterdam link
* remove symlinks
* more zh punctuation
* apply lost comment by @zhang2014
* Apply comments by @zhang2014 from #3417
* Remove Beijing link
* rm incorrect symlink
* restore content of docs/zh/operations/table_engines/index.md
* CLICKHOUSE-3751: stem terms while searching docs
* CLICKHOUSE-3751: use English stemmer in non-English docs too
* CLICKHOUSE-4135 fix
* Remove past meetup link
* Add blog link to top nav
* Add ContentSquare article link
* Add form link to front page + refactor some texts
* couple markup fixes
* minor
* Introduce basic ODBC driver page in docs
* More verbose 3rd party libs disclaimer
* Put third-party stuff into a separate folder
* Separate third-party stuff in ToC too
* Update links
* Move stuff that is not really (only) a client library into a separate page
* Add clickhouse-hdfs-loader link
* Some introduction for "interfaces" section
* Rewrite tcp.md
* http_interface.md -> http.md
* fix link
* Remove unconvenient error for now
* try to guess anchor instead of failing
* remove symlink
* Remove outdated info from introduction
* remove ru roadmap.md
* replace ru roadmap.md with symlink
* Update roadmap.md
* lost file
* Title case in toc_en.yml
* Sync "Functions" ToC section with en
* Remove reference to pretty old ClickHouse release from docs
* couple lost symlinks in fa
* Close quote in proper place
* Rewrite en/getting_started/index.md
* Sync en<>ru getting_started/index.md
* minor changes
* Some gui.md refactoring
* Translate DataGrip section to ru
* Translate DataGrip section to zh
* Translate DataGrip section to fa
* Translate DBeaver section to fa
* Translate DBeaver section to zh
* Split third-party GUI to open-source and commercial
* Mention some RDBMS integrations + ad-hoc translation fixes
* Add rel="external nofollow" to outgoing links from docs
* Lost blank lines
* Fix class name
* More rel="external nofollow"
* Apply suggestions by @sundy-li
* Mobile version of front page improvements
* test
* test 2
* test 3
* Update LICENSE
* minor docs fix
* Highlight current article as suggested by @sundy-li
* fix link destination
* Introduce backup.md (only "en" for now)
* Mention INSERT+SELECT in backup.md
* Some improvements for replication.md
* Add backup.md to toc
* Mention clickhouse-backup tool
* Mention LightHouse in third-party GUI list
* Introduce interfaces/third-party/proxy.md
* Add clickhouse-bulk to proxy.md
* Major extension of integrations.md contents
* fix link target
* remove unneeded file
* better toc item name
* fix markdown
* better ru punctuation
* Add yet another possible backup approach
* Simplify copying permalinks to headers
* Support non-eng link anchors in docs + update some deps
* Generate anchors for single-page mode automatically
* Remove anchors to top of pages
* Remove anchors that nobody links to
* build fixes
* fix few links
* restore css
* fix some links
* restore gifs
* fix lost words
* more docs fixes
* docs fixes
* NULL anchor
* update urllib3 dependency
* more fixes
* Update of english version of descriprion of the table function `file`.
* New syntax for ReplacingMergeTree.
Some improvements in text.
* Significantly change article about SummingMergeTree.
Article is restructured, text is changed in many places of the document. New syntax for table creation is described.
* Descriptions of AggregateFunction and AggregatingMergeTree are updated. Russian version.
* New syntax for new syntax of CREATE TABLE
* Added english docs on Aggregating, Replacing and SummingMergeTree.
* CollapsingMergeTree docs. English version.
* 1. Update of CollapsingMergeTree. 2. Minor changes in markup
* Update aggregatefunction.md
* Update aggregatefunction.md
* Update aggregatefunction.md
* Update aggregatingmergetree.md
* GraphiteMergeTree docs update.
New syntax for creation of Replicated* tables.
Minor changes in *MergeTree tables creation syntax.
* Markup fix
* Markup and language fixes
* Clarification in the CollapsingMergeTree article
* DOCAPI-4821. Sync between ru and en versions of docs.
* Fixed the ambiguity in geo functions description.
* Example of JOIN in ru docs
* Deleted misinforming example.
* Update of english version of descriprion of the table function `file`.
* New syntax for ReplacingMergeTree.
Some improvements in text.
* Significantly change article about SummingMergeTree.
Article is restructured, text is changed in many places of the document. New syntax for table creation is described.
* Descriptions of AggregateFunction and AggregatingMergeTree are updated. Russian version.
* New syntax for new syntax of CREATE TABLE
* Added english docs on Aggregating, Replacing and SummingMergeTree.
* CollapsingMergeTree docs. English version.
* 1. Update of CollapsingMergeTree. 2. Minor changes in markup
* Update aggregatefunction.md
* Update aggregatefunction.md
* Update aggregatefunction.md
* Update aggregatingmergetree.md
* GraphiteMergeTree docs update.
New syntax for creation of Replicated* tables.
Minor changes in *MergeTree tables creation syntax.
* Markup fix
* Markup and language fixes
* Clarification in the CollapsingMergeTree article
* Clarifications for MySQL table engine and toStartOfMonth function
* CLICKHOUSE-4063: less manual html @ index.md
* CLICKHOUSE-4063: recommend markdown="1" in README.md
* CLICKHOUSE-4003: manually purge custom.css for now
* CLICKHOUSE-4064: expand <details> before any print (including to pdf)
* CLICKHOUSE-3927: rearrange interfaces/formats.md a bit
* CLICKHOUSE-3306: add few http headers
* Remove copy-paste introduced in #3392
* Hopefully better chinese fonts #3392
* get rid of tabs @ custom.css
* Apply comments and patch from #3384
* Add jdbc.md to ToC and some translation, though it still looks badly incomplete
* minor punctuation
* Add some backlinks to official website from mirrors that just blindly take markdown sources
* Do not make fonts extra light
* find . -name '*.md' -type f | xargs -I{} perl -pi -e 's//g' {}
* find . -name '*.md' -type f | xargs -I{} perl -pi -e 's/ sql/g' {}
* Remove outdated stuff from roadmap.md
* Not so light font on front page too
* Refactor Chinese formats.md to match recent changes in other languages
* Some improvements for introduction/performance.md
* Minor improvements for example_datasets
* Add website/package-lock.json to .gitignore
* YT paragraph was badly outdated and there is no real reason to write a new one
* Use weird introduction article as a starting point for F.A.Q.
* Some refactoring of first half of ya_metrika_task.md
* minor
* Weird docs footer bugfix
* Forgotten redirect
* h/v scrollbars same size in docs
* CLICKHOUSE-3831: introduce security changelog
* A bit more narrow tables on docs front page
* fix flag in ru docs
* Save some space in top level of docs ToC
* Capitalize most words in titles of docs/en/
* more docs scrollbar fixes
* fix incorrect merge
* fix link
* fix switching languages in single page docs mode
* Update mkdocs & mkdocs-material + unminify javascript
* cherrypick 17e18d1ecc
* Additional .gitignore entries
* Merge a bunch of small articles about system tables into single one
* Merge a bunch of small articles about formats into single one
* Adapt table with formats to English docs too
* Add SPb meetup link to main page
* Move Utilities out of top level of docs (the location is probably not yet final) + translate couple articles
* Merge MacOS.md into build_osx.md
* Move Data types higher in ToC
* Publish changelog on website alongside documentation
* Few fixes for en/table_engines/file.md
* Use smaller header sizes in changelogs
* Group up table engines inside ToC
* Move table engines out of top level too
* Specificy in ToC that query language is SQL based. Thats a bit excessive, but catches eye.
* Move stuff that is part of query language into respective folder
* Move table functions lower in ToC
* Lost redirects.txt update
* Do not rely on comments in yaml + fix few ru titles
* Extract major parts of queries.md into separate articles
* queries.md has been supposed to be removed
* Fix weird translation
* Fix a bunch of links
* There is only table of contents left
* "Query language" is actually part of SQL abbreviation
* Change filename in README.md too
* fix mistype
* s/formats\/interfaces/interfaces\/formats/g
* Remove extra clarification from header as it was too verbose, probably making it a bit more confusing
* Empty article was supposed to be hidden
* At least change incorrect title
* Move special links to the bottom of nav and slightly highlight them
* Skip hidden pages in bottom navigation too
* Make front page of documentation to be part of Introduction
* Make tables in introduction somewhat readable + move abbreviation definitions earlier
* Some introduction text refactoring
* Some docs introduction refactoring
* Use admonitions instead of divs
* Additional .gitignore
* Treat .gif as images too
* Clarify ToC item
* Additional .gitignore entries
* Merge a bunch of small articles about system tables into single one
* Merge a bunch of small articles about formats into single one
* Adapt table with formats to English docs too
* Add SPb meetup link to main page
* Move Utilities out of top level of docs (the location is probably not yet final) + translate couple articles
* Merge MacOS.md into build_osx.md
* Move Data types higher in ToC
* Publish changelog on website alongside documentation
* Few fixes for en/table_engines/file.md
* Use smaller header sizes in changelogs
* Group up table engines inside ToC
* Move table engines out of top level too
* Specificy in ToC that query language is SQL based. Thats a bit excessive, but catches eye.
* Move stuff that is part of query language into respective folder
* Move table functions lower in ToC
* Lost redirects.txt update
* Do not rely on comments in yaml + fix few ru titles
* Extract major parts of queries.md into separate articles
* queries.md has been supposed to be removed
* Fix weird translation
* Fix a bunch of links
* There is only table of contents left
* "Query language" is actually part of SQL abbreviation
* Change filename in README.md too
* fix mistype
