Commit Graph

2447 Commits

Author SHA1 Message Date
VVMak
6adbd516cc
Annoy tests (#58)
* Added diskann to contrib

* Made cmake changes cleaner

* Implemented DiskANN aggregator

* Renamed index from Simple to DiskANN

* Implemented index aggregator

* Implemented index serialization

* Added condition to DiskANN index

* Implemented condition for diskann

* removed maybe_unused_attr

* Condition

* added some metrics and comparison operators

* Added common condition

* Added tests

* enchanced some tests

* Added inddex to tests

* Updated functional tests

* Added annoy tests

Co-authored-by: Danila Mishin <mishin.dk@phystech.edu>
Co-authored-by: Hakob Saghatelyan <sagatelyan.aa@phystech.edu>
2022-05-12 13:49:31 +03:00
Vladimir Makarov
c2d8498f1a Add first version of annoy-based skip-index 2022-04-01 18:47:48 +00:00
Vladimir Makarov
2f1213d25f Add original and new Annoy 2022-03-25 18:22:59 +00:00
Vladimir Makarov
4a9fbdf4dc try to add spotify-annoy 2022-03-25 12:48:04 +00:00
Vladimir Makarov
dd1df58559 Fix and move Annoy 2022-03-24 19:40:09 +00:00
Azat Khuzhin
71c9d4f39c Fix possible "nmalloc >= ndalloc" jemalloc assertion
Fixes: #31531
Refs: https://github.com/jemalloc/jemalloc/pull/2234
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-02 06:55:27 +03:00
Azat Khuzhin
01583ba10e jemalloc: fix includes order to avoid overlaps
If you had jemalloc build in contrib/jemalloc, and not current version
but some outdated, then compiler will pick incorrect file and may fail.

Also SYSTEM should be removed since regular -I is in the different list,
and will be checked before -isystem.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-21 08:32:45 +03:00
alexey-milovidov
26d0e5438c
Merge pull request #33057 from azat/jemalloc-dev-branch
[RFC] Update jemalloc to 5.3RC
2022-02-20 14:19:41 +03:00
Maksim Kita
6f9b436e3c
Merge pull request #34698 from kitaisreal/cmake-llvm-add-status-message-if-not-used
CMake llvm add status message if not used
2022-02-17 22:48:41 +01:00
Maksim Kita
0cf2b6eb07 CMake llvm add status message if not used 2022-02-17 19:46:15 +00:00
Azat Khuzhin
5a8cf3ac98 jemalloc: update version (to 5.3-rc) and commit SHA1
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:30:55 +03:00
Azat Khuzhin
c045a95a37 jemalloc: update provisioned headers for freebsd aarch64
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
d3b60c011c jemalloc: update provisioned headers for freebsd x86_64
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
04be7a5809 jemalloc: update provisioned headers for darwin aarch64
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
ac31c648ab jemalloc: update provisioned headers for darwin x86_64
Generated on osx 10.14

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
054e84c382 jemalloc: add a note about JEMALLOC_PREFIX
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
4d3c4c7c8c jemalloc: update provisioned headers for linux aarch64
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
ddcf0f96e8 jemalloc: update provisioned headers for linux ppc64le
v2: define JEMALLOC_DEFINE_MADVISE_FREE
    https://s3.amazonaws.com/clickhouse-builds/33057/6482a1c48f22d80f704bf869857091045a3f6917/binary_ppc64le/build_log.log
v3: fix pthread_atfork
    https://github.com/ClickHouse/ClickHouse/runs/5128801105?check_suite_focus=true

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

f
2022-02-17 21:25:58 +03:00
Azat Khuzhin
bd5137db15 jemalloc: update provisioned headers for linux riscv64
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
bc5aeb4dcf jemalloc: add a note about musl support
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
daa292cf5a jemalloc: remove README for linux x86_64
Note, that there is no need to disable JEMALLOC_PURGE_MADVISE_FREE,
since jemalloc does check in runtime, and ClickHouse already
successfully works w/o this change.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
1a98c1aace jemalloc: move JEMALLOC_HAVE_ATTR_FORMAT_GNU_PRINTF out from per-arch
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
e962649899 jemalloc: correctly disable JEMALLOC_HAVE_ATTR_FORMAT_GNU_PRINTF
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
560f813c46 jemalloc: cleanup README for linux x86_64
- remove GNU_SOURCE it is done in common CMakeLists.txt
- remove JEMALLOC_OVERRIDE___POSIX_MEMALIGN (there is no need to since
  __posix_memalign() does not exists in linux)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
be4d95e444 jemalloc: remove superfluous READMEs
Those were just copied from include_linux_x86_64, and replaced x86_64
with the arch.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
bc183223c5 jemalloc: update provisioned headers for linux x86_64
v2: update jemalloc

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
0c73b860e5 jemalloc: update generic headers
v2: update jemalloc one more time
v3:
- do not include jemalloc_mangle*.h
- do not change jemalloc.h
- fix for JEMALLOC_NOTHROW/JEMALLOC_SYS_NOTHROW

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
569d613326 jemalloc: update cmake rules
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
14446290f7 jemalloc: update to dev/5.3RC
And now we can use upstream jemalloc, since all required patches had
been merged into upstream (we have to use fork since there was no new
5.2.x releases).

v2: rebase to include patch for failed assert
2022-02-17 21:25:11 +03:00
Mikhail f. Shiryaev
c3bf9eb2f9
Remove PVS test 2022-02-17 12:59:47 +01:00
Geoff Genz
d19ee89d9d Remove invalid IOS setting for RocksDB CMAKE to fix Apple M1 build 2022-02-09 12:17:23 -07:00
Vitaly Baranov
9a8e45805a
Merge pull request #34226 from vitlibar/add-submodule-minizip
Add submodule minizip
2022-02-08 22:07:34 +07:00
Vitaly Baranov
f8ef1cd23d Add submodule minizip-ng 2022-02-05 23:45:16 +07:00
Amos Bird
2e8adc797c
Better handle pre-inputs before client start 2022-02-05 22:07:25 +08:00
Maksim Kita
bbf2174f2f
Merge pull request #34167 from azat/cmake-cleanup
Cmake leftovers cleanup
2022-02-02 22:55:14 +01:00
Sergei Trifonov
68bc456830
Merge pull request #34223 from azat/bump-fmt
Bump fmtlib from 7.0.0 to 8.1.1
2022-02-02 00:03:25 +03:00
Azat Khuzhin
e4697a8d41 Update fmtlib (7.0.0 -> 8.1.1)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-01 14:30:03 +03:00
Azat Khuzhin
681f4117e0 arrow: separate out orc library
v2: exclude adaptors [1]
    [1]: https://s3.amazonaws.com/clickhouse-builds/34167/6986f34741c534565621080c1742e2dd747c9792/binary_splitted/build_log.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-01-31 16:01:19 +03:00
Azat Khuzhin
0051ed5196 arrow: separate out flatbuffers library
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-01-31 16:01:19 +03:00
Azat Khuzhin
9d59d4a5d3 arrow: add a note about hdfs
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-01-31 16:01:19 +03:00
Azat Khuzhin
6fe5a0c051 rocksdb: cleanup include directories leftovers (after cmake cleanup)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-01-31 16:01:11 +03:00
Amos Bird
ae16b362d3
Better case-insensitive completion 2022-01-30 19:50:24 +08:00
Amos Bird
666313b51a
Bump replxx 2022-01-30 19:48:34 +08:00
mergify[bot]
3f9ed4fb0b
Merge branch 'master' into fix-orc 2022-01-27 18:22:52 +00:00
Nikolay Degterinsky
c5ca5b608e
Merge pull request #33314 from evillique/classification
Merge functions for text classification
2022-01-27 17:15:08 +03:00
avogar
4aa2c41106 Fix contrib 2022-01-27 13:49:56 +03:00
mergify[bot]
f978ca276d
Merge branch 'master' into fix-orc 2022-01-26 13:12:34 +00:00
Kruglov Pavel
1b19139f74
Merge pull request #31862 from Avogar/fix-lz4
Try to fix lz4 compression
2022-01-25 14:34:45 +03:00
avogar
356de038ae Fix segfault while parsing corrupted file 2022-01-25 14:31:49 +03:00
Nikolay Degterinsky
5edbae6734 Merge branch 'master' into classification 2022-01-25 10:22:47 +00:00