Commit Graph

148 Commits

Author SHA1 Message Date
avogar
6934e27e8b Add union mode for schema inference to infer union schema of files with different schemas 2023-10-20 20:46:41 +00:00
avogar
6dcaa387b1 Fix style 2023-09-25 22:15:41 +00:00
avogar
cabb3ddaae Fix tests 2023-09-25 21:45:11 +00:00
avogar
894513f6cd Fix tests 2023-08-23 18:43:08 +00:00
avogar
b4145aeddc Cache number of rows in files for count in file/s3/url/hdfs/azure functions 2023-08-22 11:59:59 +00:00
Kruglov Pavel
0d34e97dbe
Merge branch 'master' into formats-with-subcolumns 2023-07-26 13:30:35 +02:00
avogar
98aa6b317f Support reading subcolumns from file/s3/hdfs/url/azureBlobStorage table functions 2023-07-04 21:17:26 +00:00
zvonand
84bb17033c fix black 2023-06-22 19:48:28 +02:00
Andrey Zvonov
765b4ce279 added wrong path for hdfs test 2023-06-22 17:19:47 +02:00
zvonand
1c10578f14 update to master 2023-06-16 21:30:47 +02:00
zvonand
1d8013074d fix style & black 2023-06-13 18:47:02 +02:00
Andrey Zvonov
427c5cb1ba fix integration test 2023-06-11 18:42:10 +02:00
zvonand
aad7712b18 add existing test 2023-06-11 02:09:05 +02:00
avogar
d4efbbfbd3 Allow to skip empty files in file/s3/url/hdfs table functions 2023-05-30 19:32:24 +00:00
kigerzhang
af5a8ce74c style check 2023-02-23 17:18:56 +08:00
kigerzhang
f74f3718a0 add skip_unavailable_shards setting for table function cluste 2023-02-23 17:05:51 +08:00
chen
cb83337586
Update test.py 2022-11-17 06:41:43 +08:00
xiedeyantu
fc1d06f096 fix 2022-11-16 23:43:23 +08:00
xiedeyantu
7dc941cacd fix 2022-11-16 19:47:57 +08:00
xiedeyantu
c23cd091a3 fix 2022-11-16 09:59:44 +08:00
xiedeyantu
8144516e53 fix 2022-11-16 09:33:46 +08:00
xiedeyantu
3d218795be fix 2022-11-16 09:18:45 +08:00
xiedeyantu
ec6698395e fix skip_unavailable_shards does not work using hdfsCluster table function 2022-11-15 13:25:15 +08:00
avogar
93d0113b14 Fix flacky schema inference cache tests 2022-08-24 11:28:56 +00:00
avogar
8dd54c043d Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-cache 2022-08-17 11:47:40 +00:00
avogar
d5f7337ba3 Try fix tests 2022-08-16 14:57:19 +00:00
Kruglov Pavel
795262f16c
Fix hdfs test 2022-08-16 12:39:35 +02:00
avogar
c4ff3ffeea Rename settings 2022-08-15 12:45:18 +00:00
avogar
c0bb6303b9 Fix check black 2022-08-11 10:55:18 +00:00
avogar
9b1a267203 Refactor, remove TTL, add size limit, add system table and system query 2022-08-05 16:20:15 +00:00
avogar
02c90fd94b Fix tests 2022-07-21 16:54:42 +00:00
Kruglov Pavel
5904aa1ae0
Fix check black 2022-06-29 13:10:39 +02:00
avogar
106f92dcdb Fix tests 2022-06-28 16:13:42 +00:00
avogar
b0c9d1a25d Fix style 2022-06-27 14:04:28 +00:00
avogar
5155262a16 Add some additional information to cache keys 2022-06-27 12:43:24 +00:00
avogar
d37ad2e6de Implement cache for schema inference for file/s3/hdfs/url 2022-06-21 13:02:48 +00:00
Kruglov Pavel
af3db5a992
Merge pull request #36726 from PolyProgrammist/s3clustermacro
Handle cluster macro in s3Cluster table function
2022-05-11 18:00:57 +02:00
Vadim Volodin
233f0b4b52 Handle cluster macro in s3Cluster table function 2022-04-28 18:38:17 +03:00
Kruglov Pavel
6ddebf7d38
Fix style 2022-04-20 16:34:05 +02:00
avogar
1c065f8c7a Some refactoring around schema inference with globs 2022-04-13 17:02:48 +00:00
lgbo-ustc
759e4a9a05 Merge remote-tracking branch 'ck/master' into s3_cluster_join 2022-04-08 09:25:30 +08:00
lgbo-ustc
dbdc632243 fixed code style 2022-04-07 18:11:49 +08:00
kssenii
f17a320635 Fix test 2022-03-31 11:13:38 +02:00
lgbo-ustc
d0e5b3571c fixed code style 2022-03-31 09:28:07 +08:00
kssenii
d810853b78 Fix path in test 2022-03-30 17:35:59 +02:00
lgbo-ustc
08e1fdc6b8 Fixed :a elimate AMBIGUOUS_COLUMN_NAME exception
elimate AMBIGUOUS_COLUMN_NAME exception in hdfs/s3 cluster when run a query with join
2022-03-30 17:06:38 +08:00
kssenii
edf0436f5c Fix style check 2022-03-25 10:14:14 +01:00
kssenii
e91e30aaa4 Fix 2022-03-24 17:10:27 +01:00
Mikhail f. Shiryaev
e6f5a3f98b
Apply black formatter to all *.py files in the repo 2022-03-22 17:39:58 +01:00
avogar
916ce3f96d Fix tests 2022-02-28 10:07:29 +00:00
avogar
653d769d34 Support schema inference for INSERT INTO FUNCTION 2022-02-18 16:19:42 +00:00
avogar
84087c1554 Improve schema inference with globs 2022-02-09 19:16:15 +03:00
Kruglov Pavel
7bfb1231b9
Merge branch 'master' into formats-with-suffixes 2022-01-20 14:47:17 +03:00
avogar
4efadfad3c Fix tests 2022-01-18 22:26:13 +03:00
liuneng1994
15ea37c4ae ignore file not found exception
Signed-off-by: neng.liu <neng.liu@kyligence.io>
2022-01-18 12:49:40 +00:00
mergify[bot]
df869c5b9c
Merge branch 'master' into fix_ignore_hdfs_error 2022-01-18 07:05:24 +00:00
liuneng1994
c6e205b2ad add error check 2022-01-18 06:21:40 +00:00
Kruglov Pavel
a7df9cd53a
Merge branch 'master' into formats-with-suffixes 2022-01-14 21:03:49 +03:00
avogar
2f000a178a Add more tests 2022-01-14 14:00:50 +03:00
avogar
97788b9c21 Allow to create new files on insert for File/S3/HDFS engines 2021-12-29 21:19:13 +03:00
avogar
9f30c17777 Fix tests 2021-12-29 12:18:56 +03:00
avogar
74f09d6476 Fix tests 2021-12-29 12:18:56 +03:00
avogar
aaf9f85c67 Add more tests and fixes 2021-12-29 12:18:56 +03:00
Zhichang Yu
869cdbeb44 added table function hdfsCluster 2021-12-20 13:14:44 +00:00
taiyang-li
9d1e63be0f 1. support default expression for storage hdfs; 2. optimize storage hdfs when format is column oriented 2021-12-06 11:54:45 +08:00
kssenii
46d2fdc5e6 Update 2021-11-24 21:53:53 +03:00
kssenii
f18dcd2287 Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers 2021-11-13 14:38:57 +03:00
Kseniia Sumarokova
f3dc7c0e5d
Update test.py 2021-11-10 17:21:25 +03:00
Kseniia Sumarokova
a18fd8bdfc
Fix 2021-11-10 17:20:25 +03:00
avogar
f10dfbe61a fix tests 2021-11-08 14:12:37 +03:00
kssenii
ec11179f91 Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers 2021-11-03 14:33:31 +03:00
kssenii
45ea820297 Reduce memory usage for some formats 2021-11-03 14:30:03 +03:00
kssenii
20772fde04 For storage 2021-10-27 10:04:17 +03:00
kssenii
1d743b9259 Partitoned write 2021-10-25 19:23:44 +03:00
Yatsishin Ilya
a4a960328e Merge remote-tracking branch 'origin' into integration-6 2021-07-12 11:34:23 +03:00
Yatsishin Ilya
143368d8d6 wip 2021-07-12 11:32:20 +03:00
Kseniia Sumarokova
ed687f45a1
Merge branch 'master' into truncate 2021-06-30 20:08:42 +03:00
Vitaly Baranov
3a3cbeb7aa Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
kssenii
ac0f86cdbf Truncate for s3 2021-06-21 15:44:36 +00:00
kssenii
4688f9e038 hdfs truncate table 2021-06-21 13:59:57 +00:00
Yatsishin Ilya
aba39d58f9 wip 2021-06-09 12:23:02 +03:00
Yatsishin Ilya
30b05fec42 fix 2021-04-27 20:20:13 +03:00
Yatsishin Ilya
b80d4f8e96 fix 2021-04-27 20:18:09 +03:00
Yatsishin Ilya
c59a11f798 Merge remote-tracking branch 'origin' into integration-2 2021-04-27 18:34:33 +03:00
Kseniia Sumarokova
f9291d7624
Merge branch 'master' into fix-hdfs-virtual-columns 2021-04-20 22:01:32 +03:00
kssenii
f4d663bc56 Add test 2021-04-20 08:38:14 +00:00
kssenii
bb767b66d5 Add integration test 2021-04-19 20:39:22 +00:00
Yatsishin Ilya
ee955038c1 wip 2021-02-19 15:58:11 +03:00
Yatsishin Ilya
2df4317aba wip 2021-02-19 00:21:50 +03:00
Ilya Golshtein
7e97814859 cleanup, fixes, new submodules, ShellCommand, WriteBufferFromString 2020-12-16 14:48:33 +03:00
Ilya Golshtein
d1d657335b USE_INTERNAL_HDFS3_LIBRARY + bash lint 2020-12-16 14:48:33 +03:00
Ilya Golshtein
d9166a0645 HADOOP_SECURE_DN_USER way, kinit thread, docker capabilities 2020-12-16 14:48:33 +03:00
Ilya Golshtein
185ac744b1 kerberized hdfs compiled 2020-12-16 14:48:33 +03:00
alesapin
db03a894e5 Change test to run flaky check 2020-10-06 16:29:50 +03:00
Azat Khuzhin
9cb3c743bd
Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
bharatnc
b75963d370 Format and optimize imports in integration test files
This PR formats all the `*.py` files found under the `tests/integration`
folder. It also reorders the imports and cleans up a bunch of unused
imports.

The formatting also takes care of other things like wrapping lines and
fixing spaces and indents such that the tests look more readable.
2020-09-15 23:10:54 -07:00
Yatsishin Ilya
160776f183 Add explicit main_configs, user_configs and dictionaries in integration tests. 2020-08-12 11:55:04 +03:00
Ivan
97f2a2213e
Move all folders inside /dbms one level up (#9974)
* Move some code outside dbms/src folder
* Fix paths
2020-04-02 02:51:21 +03:00