alexey-milovidov
4c3241808d
Merge pull request #12728 from ClickHouse/prevent-inconsistent-merge-tree-settings
...
Safe logic for incorrect MergeTreeSettings
2020-07-30 17:55:39 +03:00
Alexander Kazakov
2bde393499
Merging #12548 - Correction to merge_with_ttl_timeout
logic by @excitoon ( #12982 )
...
* Fixed `merge_with_ttl_timeout` logic.
* Separate TTL-merge timers for each partition
Co-authored-by: Vladimir Chebotarev <vladimir.chebotarev@gmail.com>
2020-07-28 17:38:34 +03:00
Alexey Milovidov
798ef1b9f9
Adjustments; added test result
2020-07-27 23:18:23 +03:00
alesapin
1707f84a44
Less strict check and rare rename bug
2020-07-27 12:42:37 +03:00
alesapin
e0bf5913e7
Fix sticking mutations
2020-07-26 17:21:57 +03:00
Alexey Milovidov
6b4be2b9fe
Safe logic for incorrect MergeTreeSettings #10897
2020-07-23 15:31:09 +03:00
Artem Zuikov
2afd123eda
Refactoring: extract TreeOptimizer from SyntaxAnalyzer ( #12645 )
2020-07-22 20:13:05 +03:00
Nikolai Kochetov
cab9146ff3
Remove SortDescription from IBlockInputStream.
2020-07-21 11:05:52 +03:00
alesapin
84f8bf1e14
Merge pull request #10697 from CurtizJ/polymorphic-parts
...
Polymorphic parts (in-memory format)
2020-07-08 13:25:45 +03:00
Nikita Mikhaylov
d31ed58f01
done
2020-07-06 17:33:31 +03:00
Anton Popov
ca346ea13c
rename fsync-related settings
2020-07-03 02:41:37 +03:00
Anton Popov
b2aa565a37
allow to turn on fsync on inserts, merges and fetches
2020-06-27 17:52:16 +03:00
alesapin
6f1824f0ea
Correct merge with master
2020-06-26 14:30:23 +03:00
alesapin
e9c47dc89c
Merge branch 'master' into CurtizJ-polymorphic-parts
2020-06-26 14:27:19 +03:00
Anton Popov
f8f67a788e
allow to turn on fsync on inserts and merges
2020-06-25 19:55:45 +03:00
alesapin
c76b4b3481
Clang-tidy fixes
2020-06-22 18:51:11 +03:00
alesapin
b1e8976df4
Merge with master
2020-06-22 12:04:27 +03:00
alesapin
b9e74f4e82
Merge branch 'master' into atomic_metadata5
2020-06-22 12:03:53 +03:00
Alexey Milovidov
ad672f7ce2
Whitespace
2020-06-20 10:26:33 +03:00
Alexey Milovidov
b8769e1ada
Fix style
2020-06-20 10:24:51 +03:00
alesapin
d79982f497
Better locks in Storages
2020-06-18 19:10:47 +03:00
alesapin
dffdece350
getColumns in StorageInMemoryMetadta (only compilable)
2020-06-17 19:39:58 +03:00
alesapin
ed8f3b2fc4
TTL in storage in memory metadata
2020-06-17 16:39:26 +03:00
alesapin
1afdebeebd
Primary key in storage metadata
2020-06-17 15:39:20 +03:00
alesapin
eca6e9087e
Fix race condition
2020-06-17 14:52:19 +03:00
alesapin
ba04d02f1e
Compilable sorting key in metadata
2020-06-17 14:05:11 +03:00
alesapin
62f2c17a66
Secondary indices in StorageInMemoryMetadata
2020-06-17 12:38:47 +03:00
alesapin
2fac3290f0
Merge branch 'master' into atomic_metadata5
2020-06-17 11:14:03 +03:00
alesapin
1ddeb3d149
Buildable getSampleBlock in StorageInMemoryMetadata
2020-06-16 18:51:29 +03:00
alesapin
71f99a274d
Compileable getSampleBlockWithColumns in StorageInMemoryMetadata
2020-06-16 17:25:08 +03:00
alesapin
0bcd22008a
Get column dependencies in StorageInMemoryMetadata
2020-06-16 15:19:21 +03:00
Alexey Milovidov
689b6901f8
Fix typo
2020-06-15 04:04:42 +03:00
Anton Popov
66e31d4311
in-memory parts: several fixes
2020-06-05 23:49:24 +03:00
Anton Popov
1ce09e1faa
Merge remote-tracking branch 'upstream/master' into polymorphic-parts
2020-06-03 16:27:54 +03:00
Alexander Kuzmenkov
c7d9094a7a
Merge pull request #11259 from ClickHouse/consistent_metadata3
...
More consistent metadata for secondary indices
2020-06-03 12:23:21 +03:00
alesapin
ad6447398f
Fix indices calculation during merge
2020-06-01 22:58:30 +03:00
Nikolai Kochetov
325393d340
Try fix build.
2020-06-01 19:58:36 +03:00
alesapin
e0e77194f4
Remove redundant parts from MergeTree
2020-06-01 15:39:20 +03:00
alesapin
663e92b1c5
Rename to methods
2020-06-01 14:29:11 +03:00
alesapin
3847ea892d
Merge branch 'master' into consistent_metadata3
2020-06-01 13:17:59 +03:00
alexey-milovidov
9984e989c1
Merge pull request #11317 from ClickHouse/logger-fmt-2
...
Preparation for structured logging
2020-06-01 00:11:29 +03:00
Alexey Milovidov
07c14e12dd
Fix build after merge of #11162 with master
2020-05-31 19:53:30 +03:00
alexey-milovidov
8accde79b5
Merge pull request #11162 from azat/data-skip-index-merging-params-fix
...
[RFC] Fix data skipping indexes for columns with additional actions during merge
2020-05-31 19:10:53 +03:00
alexey-milovidov
9416e82b75
Update MergeTreeDataMergerMutator.cpp
2020-05-31 19:06:59 +03:00
Alexey Milovidov
25f941020b
Remove namespace pollution
2020-05-31 00:57:37 +03:00
Alexey Milovidov
5aff138956
Preparation for structured logging
2020-05-31 00:35:52 +03:00
alesapin
5f8b69547b
More readable code
2020-05-28 16:45:08 +03:00
alesapin
26a9829e04
Indices description as vector
2020-05-28 15:47:17 +03:00
alesapin
52ca6b2051
I'm able to build it
2020-05-28 15:37:05 +03:00
alesapin
c3a6571036
Compilable code
2020-05-25 20:22:20 +03:00
alesapin
6281dd6893
Merge pull request #11115 from ClickHouse/consistent_metadata
...
Refactoring in storage metadata (more consistent keys)
2020-05-25 13:09:56 +03:00
Azat Khuzhin
c36708caf9
Split data skipping indexes from the order by to evaluate order by before merge
2020-05-24 16:12:08 +03:00
Azat Khuzhin
71731b2e99
Fix data skipping indexes for columns with additional actions during merge
...
For example for AggregatingMergeTree if the column in the data skipping
index is under some aggregate function, then data skipping index will be
incorrect.
Fix this by calculating data skipping indexes after aggregation has been
done.
2020-05-24 16:12:08 +03:00
Alexey Milovidov
7e1813825b
Return old names of macros
2020-05-24 01:24:01 +03:00
Alexey Milovidov
c87fb91532
Progress on task
2020-05-24 00:41:35 +03:00
Alexey Milovidov
cd6d3c7509
Progress on task
2020-05-23 22:55:06 +03:00
Alexey Milovidov
7e2fb9ad65
Apply all transformations again
2020-05-23 22:38:30 +03:00
Alexey Milovidov
29762240de
Remove duplicate whitespaces (preparation)
2020-05-23 22:31:54 +03:00
Alexey Milovidov
a2ad11897f
Remove duplicate whitespaces (preparation)
2020-05-23 21:53:58 +03:00
Alexey Milovidov
1f13515a65
Make all LOG in single line (preparation)
2020-05-23 21:31:37 +03:00
Alexey Milovidov
3384f3b77e
Progress on task
2020-05-23 21:07:38 +03:00
Alexey Milovidov
9d24908e53
Progress on task
2020-05-23 20:52:11 +03:00
Alexey Milovidov
f68d1ceb4f
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}\5{}\7{}", \4, \6, \8);/'
2020-05-23 20:02:09 +03:00
Alexey Milovidov
8042e5febe
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}\5{}", \4, \6);/'
2020-05-23 19:58:15 +03:00
Alexey Milovidov
e391b77d81
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5", \4);/'
2020-05-23 19:56:05 +03:00
Alexey Milovidov
ee4ffbc332
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}", \4);/'
2020-05-23 19:47:56 +03:00
Alexey Milovidov
8d2e80a5e2
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+"\)' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+, "[^"]+")\)/\1_FORMATTED(\2)/'
2020-05-23 19:42:39 +03:00
alesapin
327d17ac6a
Better
2020-05-21 22:46:03 +03:00
Azat Khuzhin
d93b9a57f6
Forward declaration for Context as much as possible.
...
Now after changing Context.h 488 modules will be recompiled instead of 582.
2020-05-21 01:53:18 +03:00
alesapin
616902a995
Sorting and primary key (broken)
2020-05-20 21:11:38 +03:00
Anton Popov
4fb6492b08
in-memory parts: delay merges
2020-05-20 15:02:02 +03:00
alesapin
dc330ca7cb
Merge pull request #11037 from ClickHouse/alter_rename_and_modify
...
Fix alter rename with different types of alter
2020-05-20 11:28:13 +03:00
alesapin
7d382cc7b5
Return missed command
2020-05-19 19:03:10 +03:00
alesapin
4906dbef41
Remove redundant logs
2020-05-19 13:46:56 +03:00
alesapin
2b37a418f2
More clear logic
2020-05-19 13:44:53 +03:00
alesapin
111c576579
Slightly less garbage
2020-05-19 13:03:05 +03:00
alesapin
70e5553204
At least something works
2020-05-19 12:54:56 +03:00
alesapin
07cb21ccb7
Merge branch 'master' into refactor-reservations
2020-05-18 11:43:48 +03:00
alexey-milovidov
7efd2a825f
Merge pull request #10463 from ClickHouse/parallel-final
...
Parallel final
2020-05-18 05:20:18 +03:00
Gleb Novikov
1a25ac6e1f
Merge branch 'master' into refactor-reservations
2020-05-16 23:34:45 +03:00
Anton Popov
4c03f48703
in-memory parts: better restoring
2020-05-15 03:39:15 +03:00
alesapin
ab760846c2
Fix some rename cases
2020-05-13 20:43:30 +03:00
alexey-milovidov
40ef113503
Merge branch 'master' into parallel-final
2020-05-11 06:47:44 +03:00
Gleb Novikov
390b39b272
VolumePtr instead of DiskPtr in MergeTreeData*
2020-05-10 00:24:15 +03:00
Anton Popov
387041a97e
Merge remote-tracking branch 'upstream/master' into polymorphic-parts
2020-05-06 19:22:07 +03:00
Gleb Novikov
c637d99e07
Volumes and storages refactoring:
...
1. Moved Volume to separate file
2. Created IVolume interface and implemented current behaviour in implementation of new interface — VolumeJBOD
3. Replaced all old volume usages with new VolumeJBOD. Where it is unnecessary to have JBOD — left just IVolume.
4. Removed old Volume completely
5. Moved StoragePolicy to separated files
6. Moved DiskSelector to separated files
7. Removed DiskSpaceMonitor file
2020-05-04 23:15:38 +03:00
Anton Popov
aa723d245f
Merge remote-tracking branch 'upstream/master' into polymorphic-parts
2020-04-30 18:27:39 +03:00
Nikolai Kochetov
19dadb8c2d
Add parallel final.
2020-04-30 12:59:08 +03:00
Nikita Mikhaylov
2173bcf28e
Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug
2020-04-21 14:35:06 +03:00
Alexey Milovidov
d7264b292d
Merge branch 'master' into sorting-processors
2020-04-20 09:29:41 +03:00
Anton Popov
391f7c34be
in memory parts: basic read/write
2020-04-17 20:30:46 +03:00
Anton Popov
f7b7b5eb74
remove unused flags
2020-04-17 14:59:10 +03:00
Nikita Mikhaylov
85fbf413c1
server crashes, just to save
2020-04-16 21:47:20 +03:00
Nikolai Kochetov
153f795ebe
Merge branch 'master' into sorting-processors
2020-04-15 12:07:05 +03:00
Nikita Mikhaylov
89f80a6353
Merge branch 'master' into quorum_bug
2020-04-13 23:25:55 +04:00
Nikita Mikhaylov
441bb13d4a
better
2020-04-13 18:21:05 +03:00
Nikita Mikhaylov
a8d72d01c3
mvp fix
2020-04-11 00:29:54 +03:00
Anton Popov
d018977f4b
fix 'ALTER CLEAR INDEX/COLUMN' queries with compact parts
2020-04-10 16:36:51 +03:00
Nikolai Kochetov
1b6d80bfae
Merge branch 'master' into sorting-processors
2020-04-10 12:07:21 +03:00
alesapin
1cb072d58a
Merge branch 'master' into alter_rename_column
2020-04-06 11:40:27 +03:00