158 Commits

Author	SHA1	Message	Date
avogar	8accf395fb	Fix for HDFS and Azure	2024-04-08 20:37:06 +00:00
avogar	ef518946f3	Respect settings truncate_on_insert/create_new_file_on_insert in s3/hdfs/azure engines	2024-04-08 20:18:47 +00:00
kssenii	961704ba17	Style check	2024-03-28 15:00:49 +01:00
kssenii	5c63d09c5b	More tests fixes	2024-03-28 14:15:14 +01:00
kssenii	480251e593	Fix style check	2024-03-27 19:28:11 +01:00
kssenii	7a991de488	Fix tests	2024-03-27 19:06:19 +01:00
Max Kainov	7b8c5f35b5	disable test_strage_hdfs module ... #ci_set_arm #batch_2 #no_merge_commit	2024-03-20 17:24:55 +00:00
Kruglov Pavel	918614970b	Fix style	2024-01-26 02:02:03 +01:00
avogar	11f1ea50d7	Fix tests	2024-01-24 17:55:31 +00:00
avogar	617cc514b7	Try to detect file format automatically during schema inference if it's unknown	2024-01-23 18:59:39 +00:00
avogar	6934e27e8b	Add union mode for schema inference to infer union schema of files with different schemas	2023-10-20 20:46:41 +00:00
avogar	6dcaa387b1	Fix style	2023-09-25 22:15:41 +00:00
avogar	cabb3ddaae	Fix tests	2023-09-25 21:45:11 +00:00
avogar	894513f6cd	Fix tests	2023-08-23 18:43:08 +00:00
avogar	b4145aeddc	Cache number of rows in files for count in file/s3/url/hdfs/azure functions	2023-08-22 11:59:59 +00:00
Kruglov Pavel	0d34e97dbe	Merge branch 'master' into formats-with-subcolumns	2023-07-26 13:30:35 +02:00
avogar	98aa6b317f	Support reading subcolumns from file/s3/hdfs/url/azureBlobStorage table functions	2023-07-04 21:17:26 +00:00
zvonand	84bb17033c	fix black	2023-06-22 19:48:28 +02:00
Andrey Zvonov	765b4ce279	added wrong path for hdfs test	2023-06-22 17:19:47 +02:00
zvonand	1c10578f14	update to master	2023-06-16 21:30:47 +02:00
zvonand	1d8013074d	fix style & black	2023-06-13 18:47:02 +02:00
Andrey Zvonov	427c5cb1ba	fix integration test	2023-06-11 18:42:10 +02:00
zvonand	aad7712b18	add existing test	2023-06-11 02:09:05 +02:00
avogar	d4efbbfbd3	Allow to skip empty files in file/s3/url/hdfs table functions	2023-05-30 19:32:24 +00:00
kigerzhang	af5a8ce74c	style check	2023-02-23 17:18:56 +08:00
kigerzhang	f74f3718a0	add skip_unavailable_shards setting for table function cluste	2023-02-23 17:05:51 +08:00
chen	cb83337586	Update test.py	2022-11-17 06:41:43 +08:00
xiedeyantu	fc1d06f096	fix	2022-11-16 23:43:23 +08:00
xiedeyantu	7dc941cacd	fix	2022-11-16 19:47:57 +08:00
xiedeyantu	c23cd091a3	fix	2022-11-16 09:59:44 +08:00
xiedeyantu	8144516e53	fix	2022-11-16 09:33:46 +08:00
xiedeyantu	3d218795be	fix	2022-11-16 09:18:45 +08:00
xiedeyantu	ec6698395e	fix skip_unavailable_shards does not work using hdfsCluster table function	2022-11-15 13:25:15 +08:00
avogar	93d0113b14	Fix flacky schema inference cache tests	2022-08-24 11:28:56 +00:00
avogar	8dd54c043d	Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-cache	2022-08-17 11:47:40 +00:00
avogar	d5f7337ba3	Try fix tests	2022-08-16 14:57:19 +00:00
Kruglov Pavel	795262f16c	Fix hdfs test	2022-08-16 12:39:35 +02:00
avogar	c4ff3ffeea	Rename settings	2022-08-15 12:45:18 +00:00
avogar	c0bb6303b9	Fix check black	2022-08-11 10:55:18 +00:00
avogar	9b1a267203	Refactor, remove TTL, add size limit, add system table and system query	2022-08-05 16:20:15 +00:00
avogar	02c90fd94b	Fix tests	2022-07-21 16:54:42 +00:00
Kruglov Pavel	5904aa1ae0	Fix check black	2022-06-29 13:10:39 +02:00
avogar	106f92dcdb	Fix tests	2022-06-28 16:13:42 +00:00
avogar	b0c9d1a25d	Fix style	2022-06-27 14:04:28 +00:00
avogar	5155262a16	Add some additional information to cache keys	2022-06-27 12:43:24 +00:00
avogar	d37ad2e6de	Implement cache for schema inference for file/s3/hdfs/url	2022-06-21 13:02:48 +00:00
Kruglov Pavel	af3db5a992	Merge pull request #36726 from PolyProgrammist/s3clustermacro ... Handle cluster macro in s3Cluster table function	2022-05-11 18:00:57 +02:00
Vadim Volodin	233f0b4b52	Handle cluster macro in s3Cluster table function	2022-04-28 18:38:17 +03:00
Kruglov Pavel	6ddebf7d38	Fix style	2022-04-20 16:34:05 +02:00
avogar	1c065f8c7a	Some refactoring around schema inference with globs	2022-04-13 17:02:48 +00:00
lgbo-ustc	759e4a9a05	Merge remote-tracking branch 'ck/master' into s3_cluster_join	2022-04-08 09:25:30 +08:00
lgbo-ustc	dbdc632243	fixed code style	2022-04-07 18:11:49 +08:00
kssenii	f17a320635	Fix test	2022-03-31 11:13:38 +02:00
lgbo-ustc	d0e5b3571c	fixed code style	2022-03-31 09:28:07 +08:00
kssenii	d810853b78	Fix path in test	2022-03-30 17:35:59 +02:00
lgbo-ustc	08e1fdc6b8	Fixed :a elimate AMBIGUOUS_COLUMN_NAME exception ... elimate AMBIGUOUS_COLUMN_NAME exception in hdfs/s3 cluster when run a query with join	2022-03-30 17:06:38 +08:00
kssenii	edf0436f5c	Fix style check	2022-03-25 10:14:14 +01:00
kssenii	e91e30aaa4	Fix	2022-03-24 17:10:27 +01:00
Mikhail f. Shiryaev	e6f5a3f98b	Apply black formatter to all *.py files in the repo	2022-03-22 17:39:58 +01:00
avogar	916ce3f96d	Fix tests	2022-02-28 10:07:29 +00:00
avogar	653d769d34	Support schema inference for INSERT INTO FUNCTION	2022-02-18 16:19:42 +00:00
avogar	84087c1554	Improve schema inference with globs	2022-02-09 19:16:15 +03:00
Kruglov Pavel	7bfb1231b9	Merge branch 'master' into formats-with-suffixes	2022-01-20 14:47:17 +03:00
avogar	4efadfad3c	Fix tests	2022-01-18 22:26:13 +03:00
liuneng1994	15ea37c4ae	ignore file not found exception ... Signed-off-by: neng.liu <neng.liu@kyligence.io>	2022-01-18 12:49:40 +00:00
mergify[bot]	df869c5b9c	Merge branch 'master' into fix_ignore_hdfs_error	2022-01-18 07:05:24 +00:00
liuneng1994	c6e205b2ad	add error check	2022-01-18 06:21:40 +00:00
Kruglov Pavel	a7df9cd53a	Merge branch 'master' into formats-with-suffixes	2022-01-14 21:03:49 +03:00
avogar	2f000a178a	Add more tests	2022-01-14 14:00:50 +03:00
avogar	97788b9c21	Allow to create new files on insert for File/S3/HDFS engines	2021-12-29 21:19:13 +03:00
avogar	9f30c17777	Fix tests	2021-12-29 12:18:56 +03:00
avogar	74f09d6476	Fix tests	2021-12-29 12:18:56 +03:00
avogar	aaf9f85c67	Add more tests and fixes	2021-12-29 12:18:56 +03:00
Zhichang Yu	869cdbeb44	added table function hdfsCluster	2021-12-20 13:14:44 +00:00
taiyang-li	9d1e63be0f	1. support default expression for storage hdfs; 2. optimize storage hdfs when format is column oriented	2021-12-06 11:54:45 +08:00
kssenii	46d2fdc5e6	Update	2021-11-24 21:53:53 +03:00
kssenii	f18dcd2287	Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers	2021-11-13 14:38:57 +03:00
Kseniia Sumarokova	f3dc7c0e5d	Update test.py	2021-11-10 17:21:25 +03:00
Kseniia Sumarokova	a18fd8bdfc	Fix	2021-11-10 17:20:25 +03:00
avogar	f10dfbe61a	fix tests	2021-11-08 14:12:37 +03:00
kssenii	ec11179f91	Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers	2021-11-03 14:33:31 +03:00
kssenii	45ea820297	Reduce memory usage for some formats	2021-11-03 14:30:03 +03:00
kssenii	20772fde04	For storage	2021-10-27 10:04:17 +03:00
kssenii	1d743b9259	Partitoned write	2021-10-25 19:23:44 +03:00
Yatsishin Ilya	a4a960328e	Merge remote-tracking branch 'origin' into integration-6	2021-07-12 11:34:23 +03:00
Yatsishin Ilya	143368d8d6	wip	2021-07-12 11:32:20 +03:00
Kseniia Sumarokova	ed687f45a1	Merge branch 'master' into truncate	2021-06-30 20:08:42 +03:00
Vitaly Baranov	3a3cbeb7aa	Collect stderr.log and stdout.log in all integration tests by default.	2021-06-29 17:30:47 +03:00
kssenii	ac0f86cdbf	Truncate for s3	2021-06-21 15:44:36 +00:00
kssenii	4688f9e038	hdfs truncate table	2021-06-21 13:59:57 +00:00
Yatsishin Ilya	aba39d58f9	wip	2021-06-09 12:23:02 +03:00
Yatsishin Ilya	30b05fec42	fix	2021-04-27 20:20:13 +03:00
Yatsishin Ilya	b80d4f8e96	fix	2021-04-27 20:18:09 +03:00
Yatsishin Ilya	c59a11f798	Merge remote-tracking branch 'origin' into integration-2	2021-04-27 18:34:33 +03:00
Kseniia Sumarokova	f9291d7624	Merge branch 'master' into fix-hdfs-virtual-columns	2021-04-20 22:01:32 +03:00
kssenii	f4d663bc56	Add test	2021-04-20 08:38:14 +00:00
kssenii	bb767b66d5	Add integration test	2021-04-19 20:39:22 +00:00
Yatsishin Ilya	ee955038c1	wip	2021-02-19 15:58:11 +03:00
Yatsishin Ilya	2df4317aba	wip	2021-02-19 00:21:50 +03:00
Ilya Golshtein	7e97814859	cleanup, fixes, new submodules, ShellCommand, WriteBufferFromString	2020-12-16 14:48:33 +03:00