Antonio Andelic
84f86bf3da
Limit number of bytes read per worker
2022-03-16 12:34:14 +00:00
Antonio Andelic
2291b7c1e1
Merge branch 'master' into parallel-downloading-url-engine
2022-03-16 09:59:52 +00:00
Nikolai Kochetov
a380aa6b8a
Merge pull request #35294 from ClickHouse/reload-remote_url_allow_hosts
...
Reload remote_url_allow_hosts after config update.
2022-03-15 22:07:16 +01:00
Nikolai Kochetov
97aa6c82ce
Reload remote_url_allow_hosts after config update.
2022-03-15 13:00:31 +00:00
Antonio Andelic
adaaaaf061
Unblock readers before stoping
2022-03-11 08:33:34 +00:00
Antonio Andelic
c6664bbbdf
Add seekable ParallelReadBuffer
2022-03-11 08:33:34 +00:00
Antonio Andelic
29c32ed831
Refactor code
2022-03-11 08:33:34 +00:00
Antonio Andelic
0a1a3a230e
Add support for parallel http range requests
2022-03-11 08:33:34 +00:00
Antonio Andelic
aad87879cf
Small refactor
2022-03-11 08:33:34 +00:00
kssenii
050802b99b
Add non-retriable errors
2022-03-10 11:38:46 +01:00
Saad Ur Rahman
03f81c8685
[CH-34239] HTTP User-Agent header ( #34330 )
...
* [IO] HTTP User-Agent header
Added HTTP User-Agent Header to HTTP requests.
User-Agent: ClickHouse/VERSION_STRING
Input header vectors could potentially contain User-Agent. If so, do not set another.
* [Tests] HTTP User Agent
Added stateless functional test 02205_HTTP_user_agent.
Co-authored-by: Filatenkov Artur <58165623+FArthur-cmd@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2022-02-13 00:40:11 +03:00
kssenii
e8a8f46864
Fix style check
2022-02-08 21:58:03 +01:00
Kruglov Pavel
720310fcf1
Merge branch 'master' into http-buffer-skip-not-found-url-for-globs
2022-02-08 16:56:22 +03:00
kssenii
dc5f035265
Fix
2022-02-08 13:28:10 +01:00
kssenii
3834bdbae0
Fixes
2022-02-08 11:11:18 +01:00
kssenii
eba3011ada
Fix
2022-02-07 20:40:47 +01:00
Anton Popov
1b16db72c3
fix consecutive backward seeks in seekable read buffers
2022-02-07 17:20:26 +03:00
alesapin
31753afb7e
Fix cancel logic in parallel parsing
2022-01-31 16:38:15 +03:00
Kseniia Sumarokova
947ef81f53
Update ReadWriteBufferFromHTTP.h
2021-12-16 09:14:09 +03:00
kssenii
f29ef7d18b
Add one more test
2021-11-20 15:01:45 +03:00
kssenii
f4ffedd5f3
Better
2021-11-15 10:23:35 +03:00
kssenii
f18dcd2287
Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers
2021-11-13 14:38:57 +03:00
kssenii
175f903624
Fix
2021-11-10 21:14:17 +00:00
kssenii
e166bfbf26
Save redirect result
2021-11-10 08:27:07 +00:00
Alexander Tokmakov
4f542ab019
add test
2021-11-09 23:11:02 +03:00
kssenii
7e57368c82
Fix
2021-11-08 19:48:38 +00:00
kssenii
b95f0738fb
Fix
2021-11-04 14:39:53 +00:00
kssenii
45ea820297
Reduce memory usage for some formats
2021-11-03 14:30:03 +03:00
kssenii
2940d9fd19
Squashed commit of the following:
...
commit a1acc7ed3485bd158cf42f26b2d2a1bca84b7269
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Sun Oct 31 14:47:25 2021 +0000
Fix
commit 12a27d445b
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Fri Oct 29 09:24:53 2021 +0000
Adjutments after merge with master
commit f17e321a73
Merge: 55f1ba857d
11b70a285c
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Fri Oct 29 08:03:25 2021 +0000
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
commit 55f1ba857d
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Fri Oct 29 07:38:42 2021 +0000
Small fixes
commit aeba8104d1
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Thu Oct 28 10:28:05 2021 +0000
Some more fixes
commit 82f3754b8a
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Wed Oct 27 20:20:15 2021 +0000
Slightly better
commit 2647b88a66
Merge: 7024f51b55
2bb586bed3
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Wed Oct 27 19:38:19 2021 +0000
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
commit 7024f51b55
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Wed Oct 27 18:30:25 2021 +0000
Review fixes and add test
commit 7de5fca075
Merge: 1ecb6ad05d
855b10261c
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Sun Oct 24 17:04:24 2021 +0000
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
commit 1ecb6ad05d
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Sat Oct 23 18:53:59 2021 +0000
Better
commit 710ee96878
Merge: 28d2485716
158b4c26b7
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Mon Oct 18 08:31:25 2021 +0000
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
commit 28d2485716
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Fri Oct 15 17:27:26 2021 +0000
Some fixes
commit 7c20ca07b7
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Fri Oct 15 12:59:24 2021 +0000
Fix style check
commit ccb02cac56
Merge: 9e4fe0f3c8
d1138a8a25
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Fri Oct 15 12:36:30 2021 +0000
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
commit 9e4fe0f3c8
Merge: 9814cb1b45
daed77038b
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Tue Oct 12 09:58:15 2021 +0000
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
commit 9814cb1b45
Merge: 1c8b1b1133
969999ff10
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Tue Oct 12 09:49:08 2021 +0000
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
commit 1c8b1b1133
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Tue Oct 12 09:33:07 2021 +0000
Better
commit e7dbfff5d2
Merge: 3329b668d6
198adc7ecd
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Tue Oct 12 06:19:15 2021 +0000
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-10-31 17:53:08 +03:00
kssenii
12a27d445b
Adjutments after merge with master
2021-10-29 09:29:35 +00:00
kssenii
b56c2f9499
Remove redundant lines from http buffer
2021-10-29 11:40:21 +03:00
kssenii
f17e321a73
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-10-29 08:03:25 +00:00
kssenii
55f1ba857d
Small fixes
2021-10-29 07:38:42 +00:00
kssenii
4f3433b4e1
Some clean up before merging
2021-10-29 01:04:52 +03:00
kssenii
7e2ea97e3c
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-28 18:46:21 +03:00
kssenii
8dd5c1b99d
Remove http buffer update
2021-10-28 14:28:14 +03:00
kssenii
aeba8104d1
Some more fixes
2021-10-28 10:28:05 +00:00
kssenii
3d01fbf603
Review fixes
2021-10-28 11:32:37 +03:00
Alexey Milovidov
8b4a6a2416
Remove cruft
2021-10-28 02:10:39 +03:00
kssenii
82f3754b8a
Slightly better
2021-10-27 20:20:15 +00:00
kssenii
7024f51b55
Review fixes and add test
2021-10-27 19:37:36 +00:00
kssenii
1ecb6ad05d
Better
2021-10-23 19:00:14 +00:00
kssenii
28d2485716
Some fixes
2021-10-15 17:27:26 +00:00
kssenii
edfb1a5521
Better performance for smaller number of threads
2021-10-15 15:07:39 +03:00
kssenii
1c8b1b1133
Better
2021-10-12 09:33:07 +00:00
kssenii
448d63a0fc
Range read with upper bound offset
2021-10-11 01:53:51 +03:00
kssenii
6044725baa
Revert "http allow to know total bytes to read"
...
This reverts commit 4c99f6da51
.
2021-10-10 23:37:10 +03:00
kssenii
4c99f6da51
http allow to know total bytes to read
2021-10-10 22:15:21 +03:00
kssenii
e3d2942aa6
Correct merge
2021-10-10 20:24:36 +03:00
kssenii
fde6f0507d
Merge remote-tracking branch 'origin/retriable-http' into disk-async-read
2021-10-10 20:23:44 +03:00
kssenii
24feb6674c
May be move back initialize to constructor
2021-10-08 15:38:33 +00:00
kssenii
40434519e8
Fix disk web
2021-10-08 16:02:11 +03:00
kssenii
f3f820c6e0
HTTP read buffer retries
2021-10-08 15:41:55 +03:00
kssenii
d6e1d0503d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-07 16:21:00 +03:00
Azat Khuzhin
16c72f2107
Remove unused macros from ReadWriteBufferFromHTTP
2021-10-03 14:34:03 +03:00
Alexey Milovidov
fe6b7c77c7
Rename "common" to "base"
2021-10-02 10:13:14 +03:00
kssenii
55972db866
Small fix and more comments
2021-10-01 11:38:58 +03:00
kssenii
e4bc81ac78
Better
2021-09-30 21:45:57 +03:00
Alexey Milovidov
b9b3e4b60a
Fix style and wording in #23946
2021-05-10 23:32:30 +03:00
FArthur-cmd
6363a5dd96
use path to define compression type
2021-05-09 21:58:08 +03:00
FArthur-cmd
acb09f01d4
fixing details in code style and moving tests
2021-05-08 12:46:50 +03:00
FArthur-cmd
13a6e03849
solving style-check problems
2021-05-08 10:15:14 +03:00
FArthur-cmd
4ea9851e99
fixing dictionary http source by adding wrapper
2021-05-08 02:20:30 +03:00
Ivan Lezhankin
84b88c6802
CC
2021-02-04 22:06:43 +03:00
Ivan Lezhankin
610d7b755b
Don't forget to update position of inner buffer
2021-02-04 21:50:15 +03:00
Denis Glazachev
0c39539c76
Apply path workaround on actual uri_ argument
...
Print out actual uri_ argument being used
2020-12-21 03:29:11 +04:00
Alexey Milovidov
fd84d16387
Fix "server failed to start" error
2020-11-07 03:14:53 +03:00
Alexey Milovidov
8a68ee2547
Whitespaces
2020-11-02 13:45:48 +03:00
alesapin
e40c509392
More clear callback name
2020-10-27 16:00:40 +03:00
alesapin
db16942716
Better comment
2020-10-27 15:50:43 +03:00
alesapin
dca35b1913
Add awesome test for fetch
2020-10-27 15:24:10 +03:00
alesapin
880f4bbd05
System fetches
2020-10-26 19:38:35 +03:00
Artem Zuikov
51ba12c2c3
Try speedup build ( #14809 )
2020-09-15 12:55:57 +03:00
Vitaly Baranov
cd372de417
Use SettingUInt64 only in Settings, use UInt64 in other places.
2020-07-31 19:11:27 +03:00
Alexey Milovidov
cf0bd501e5
Remove harmful default values from code
2020-06-16 01:36:12 +03:00
Alexey Milovidov
186d336e31
Use proper timeouts when communicating with xdbc-bridge
2020-06-16 01:35:15 +03:00
Alexey Milovidov
25f941020b
Remove namespace pollution
2020-05-31 00:57:37 +03:00
Alexey Milovidov
7e1813825b
Return old names of macros
2020-05-24 01:24:01 +03:00
Alexey Milovidov
ee4ffbc332
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}", \4);/'
2020-05-23 19:47:56 +03:00
Azat Khuzhin
d93b9a57f6
Forward declaration for Context as much as possible.
...
Now after changing Context.h 488 modules will be recompiled instead of 582.
2020-05-21 01:53:18 +03:00
Ivan Lezhankin
e230632645
Changes required for auto-sync with Arcadia
2020-04-16 15:31:57 +03:00
Ivan Lezhankin
06446b4f08
dbms/ → src/
2020-04-03 18:14:31 +03:00