Commit Graph

15 Commits

Author SHA1 Message Date
Robert Schulze
cc0c0c6133
A better alternative to #46344
The (experimental) inverted index writes/reads files different from the
standard files written by the other skip indexes. The original problem
was that with database engine "ordinary", DROP TABLE of a table with
inverted index finds unknown files in persistence and complains. The
same will happen with engine "atomic" but deferred. As a hotfix, the
error was silenced by explicitly adding the four files created in a
specific test to the deletion code.

This PR tries a cleaner solution where all needed files are provided via
the normal checksum structure. One drawback remains which is that the
affected files were written earlier and we don't have their checksums
available. Therefore, the inverted index is currently excluded from
CHECK TABLE.

Minimal repro:
  SET allow_experimental_inverted_index = 1;
  DROP TABLE IF EXISTS tab;
  CREATE TABLE tab(s String, INDEX af(s) TYPE inverted(2)) ENGINE = MergeTree() ORDER BY s;
  INSERT INTO tab VALUES ('Alick a01');
  CHECK TABLE tab;
  DROP TABLE IF EXISTS tab;

  run ./clickhouse-test with --db-engine Ordinary
2023-02-26 21:06:38 +00:00
Alexey Milovidov
b1e0e587e6 Inhibit index_granularity_bytes randomization in some tests 2023-02-20 23:43:11 +01:00
Robert Schulze
ce8a83aecd
Try to make 02346_full_text_search less flaky
+ `AND database = currentDatabase()` for SELECTs on system.data_skipping_indices
2023-02-10 15:56:59 +00:00
Larry Luo
7a4d499cb1 Added density to control Inverted index size 2023-01-04 19:42:45 -08:00
Larry Luo
7cc84c6743 refactor filter functions support 2022-12-31 18:05:07 -08:00
Larry Luo
71da1b1379 Updated inverted index to use ActionsDAG 2022-12-31 18:05:06 -08:00
HarryLeeIBM
6a5fef632d Added more tests and experimental flag, etc. 2022-12-31 18:05:01 -08:00
Larry Luo
7df39d9318 Generated consistent results in test 2022-12-31 18:03:14 -08:00
Larry Luo
cbe1b156b2 Improved test reliability 2022-12-31 18:03:14 -08:00
Larry Luo
657ce7c614 Cleanup code and tests 2022-12-31 18:03:13 -08:00
Larry Luo
0b63d6b5be Resolve conflicts and style errors. 2022-12-31 18:03:13 -08:00
Larry Luo
473279d257 Make full text search tests reliable 2022-12-31 18:03:13 -08:00
HarryLeeIBM
0dcfc5ec1e Add more functional tests 2022-12-31 18:03:13 -08:00
Larry Luo
1311e04d75 capture skipping granules in functional test. 2022-12-31 18:03:13 -08:00
Larry Luo
2055c8f311 Add basic full text search functional test 2022-12-31 18:03:13 -08:00