Commit Graph

46 Commits

Author SHA1 Message Date
serxa
128b8e5889 fix tests + add test for dynamic pools 2023-05-21 14:28:16 +00:00
serxa
e1509ca59d fix style 2023-05-16 08:23:06 +00:00
serxa
e4a653b41c Multiple pools support for AsyncLoader 2023-05-15 18:49:34 +00:00
serxa
5c3e9b9e85 fix style 2023-05-03 18:58:17 +00:00
serxa
94dca90219 do not polute unit test output 2023-05-03 18:43:29 +00:00
serxa
90a5695029 add AsyncLoader introspection 2023-05-03 18:19:32 +00:00
Sergei Trifonov
356bb15e96
Update src/Common/AsyncLoader.h
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2023-05-03 15:43:52 +02:00
Sergei Trifonov
eeedc5d3e7
Update src/Common/AsyncLoader.h
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2023-05-03 15:43:31 +02:00
Sergei Trifonov
5f2e6fae22
Update src/Common/AsyncLoader.h
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2023-05-03 15:42:18 +02:00
serxa
f3b97f9d1f improve helper functions 2023-05-02 09:19:27 +00:00
serxa
18d7aa345a fix 2023-05-01 12:26:37 +00:00
serxa
05477046c3 more helpers for AsyncLoader 2023-05-01 12:09:22 +00:00
serxa
75021138ed schedule() jobs recursively with its dependencies 2023-05-01 12:09:10 +00:00
serxa
23defcbf6a log progress in AsyncLoader 2023-05-01 12:08:50 +00:00
Sergei Trifonov
85d7816d65
Update src/Common/AsyncLoader.h 2023-04-27 13:55:26 +02:00
serxa
173a8a3795 fix tidy build 2023-04-26 18:39:51 +00:00
serxa
64fb8da812 improve AsyncLoader interface 2023-04-22 17:29:53 +00:00
Sergei Trifonov
4b51f12479
Update src/Common/AsyncLoader.h
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2023-04-19 13:48:38 +02:00
serxa
5390fccf50 Merge branch 'async-loader' of github.com:ClickHouse/ClickHouse into async-loader 2023-04-19 11:47:08 +00:00
serxa
2e31140ca4 review fixes 2023-04-19 11:46:56 +00:00
Sergei Trifonov
31e3a3bc0c
Update src/Common/AsyncLoader.h
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2023-04-19 13:35:58 +02:00
serxa
c672d117ea better job shutdown 2023-04-19 06:27:07 +00:00
serxa
8cc9b32af1 fix more comments 2023-04-19 06:26:59 +00:00
serxa
d4daea5f09 fix typos 2023-04-19 06:26:51 +00:00
serxa
0d7e3d4100 fix comment 2023-04-19 06:25:54 +00:00
serxa
356b934835 split AsyncLoader into .h and .cpp files + more docs 2023-04-19 06:25:45 +00:00
Sergei Trifonov
1efacba196 Update src/Common/AsyncLoader.h 2023-04-19 06:25:37 +00:00
Sergei Trifonov
281b72c413 Update src/Common/AsyncLoader.h 2023-04-19 06:25:28 +00:00
serxa
1a3780ed8e fix 2023-04-19 06:25:11 +00:00
serxa
800efd5df8 add a good comment 2023-04-19 06:24:50 +00:00
serxa
69719c0819 allow to change max number of workers in runtime 2023-04-19 06:24:42 +00:00
serxa
264956fece add test for static priorities 2023-04-19 06:24:25 +00:00
serxa
8c1f734f50 add random test with dependent tasks 2023-04-19 06:24:07 +00:00
serxa
d8bf775b9a fix worker shutdown 2023-04-19 06:24:01 +00:00
serxa
5837b09880 fix scheduling of jobs with dependencies on finished jobs 2023-04-19 06:23:39 +00:00
serxa
5ba1dc91e3 add LoadStatus::CANCELED 2023-04-19 06:23:32 +00:00
serxa
df3c5212ff test deps are completed + refactoring 2023-04-19 06:23:22 +00:00
serxa
9ac37ca3b8 add overload test 2023-04-19 06:23:14 +00:00
serxa
3be0645413 fix remove of executing tasks + add test 2023-04-19 06:22:27 +00:00
serxa
a9c51c4aca add more tests for cancel 2023-04-19 06:22:15 +00:00
serxa
5e5a38cd64 add tests for job status/wait/cancel 2023-04-19 06:22:01 +00:00
serxa
3226eadd94 add simple randomized test 2023-04-19 06:21:31 +00:00
serxa
2c29c0b2f3 add dependency cycle detection 2023-04-19 06:21:19 +00:00
serxa
b4318b4ab6 fix style 2023-04-19 06:21:08 +00:00
serxa
5d11706929 make t work, add simple test 2023-04-19 06:20:37 +00:00
serxa
3fe36a3db6 wip AsyncLoader 2023-04-19 06:20:17 +00:00