2884 Commits

Author	SHA1	Message	Date
proller	6ff1968196	Compile and likk optimize and fixes	2017-11-24 21:08:01 +03:00
proller	0d3c4f4d67	Core/FieldVisitors.h -> Common/FieldVisitors.h ... Core/Progress.h -> IO/Progress.h tests: sudo --non-interactive Fix freebsd link	2017-11-24 16:55:31 +03:00
Alexey Milovidov	859bf86a43	Fixed error found by ASan with debug libc++ (actually not dangerous) [#CLICKHOUSE-2].	2017-11-23 18:24:55 +03:00
Alexey Zatelepin	78aaa42ddd	add idempotent retries of updating the replica queue in ZooKeeper [#CLICKHOUSE-3405]	2017-11-23 16:19:29 +03:00
Alexey Milovidov	e15d637714	Miscellaneous [#CLICKHOUSE-2].	2017-11-23 05:12:09 +03:00
Alexey Milovidov	4bf120b285	Miscellaneous [#CLICKHOUSE-2].	2017-11-23 05:11:16 +03:00
Alexey Milovidov	4aa520e7be	Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams	2017-11-21 22:40:59 +03:00
Alexey Milovidov	4bc98c9253	Unification of serde of data types: development [#CLICKHOUSE-2838].	2017-11-21 05:25:36 +03:00
Alexey Milovidov	63f79b7b4f	Unification of serde of data types: development [#CLICKHOUSE-2838].	2017-11-21 05:23:41 +03:00
Amos Bird	dc6847d5c6	Fixes StorageJoin's sample block order. ... Here is a reproducible test case. ``` create table e (s UInt64, t UInt64) Engine = Memory; create table v (s UInt64, w Float64, c UInt64) Engine = Join(Any, Inner, s); insert into e values (1, 2), (1, 3), (1, 4), (2, 1), (2, 4), (3, 1), (4, 2), (4, 3); insert into v values (1, 0.5, 3), (2, 0.5, 2), (3, 1, 1), (4, 0.5, 2); select *, w, c from e any inner join v using (s); ``` # before this patch ``` ┌─s─┬─t─┬─────w─┬──────────c─┐ │ 1 │ 2 │ 4e-45 │ 1051372192 │ │ 1 │ 3 │ 4e-45 │ 1051372192 │ │ 1 │ 4 │ 4e-45 │ 1051372192 │ │ 2 │ 1 │ 3e-45 │ 1056964608 │ │ 2 │ 4 │ 3e-45 │ 1056964608 │ │ 3 │ 1 │ 1e-45 │ 1065353216 │ │ 4 │ 2 │ 3e-45 │ 1056964608 │ │ 4 │ 3 │ 3e-45 │ 1056964608 │ └───┴───┴───────┴────────────┘ ``` # after this patch ``` ┌─s─┬─t─┬───w─┬─c─┐ │ 1 │ 2 │ 0.5 │ 3 │ │ 1 │ 3 │ 0.5 │ 3 │ │ 1 │ 4 │ 0.5 │ 3 │ │ 2 │ 1 │ 0.5 │ 2 │ │ 2 │ 4 │ 0.5 │ 2 │ │ 3 │ 1 │ 1 │ 1 │ │ 4 │ 2 │ 0.5 │ 2 │ │ 4 │ 3 │ 0.5 │ 2 │ └───┴───┴─────┴───┘ ```	2017-11-20 19:46:24 +08:00
Alexey Milovidov	3b5f82000c	Fixed linking [#CLICKHOUSE-2].	2017-11-20 08:22:54 +03:00
Alexey Milovidov	3403f68c3f	Fixed linking [#CLICKHOUSE-2].	2017-11-20 08:21:50 +03:00
Alexey Milovidov	87ff2f35ec	Miscellaneous [#CLICKHOUSE-2].	2017-11-20 07:41:56 +03:00
Alexey Milovidov	2106849ec2	Miscellaneous [#CLICKHOUSE-2].	2017-11-20 07:40:51 +03:00
Alexey Milovidov	b3f6844171	Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams	2017-11-20 07:18:37 +03:00
Alexey Milovidov	fd3239dd46	Unification of serde of data types: development [#CLICKHOUSE-2838].	2017-11-20 07:18:27 +03:00
Alexey Milovidov	01e8adbfff	Removed "experimental" namespace [#CLICKHOUSE-2].	2017-11-20 07:15:43 +03:00
Alexey Milovidov	8e6466454a	Unification of serde of data types: development [#CLICKHOUSE-2838].	2017-11-20 05:15:15 +03:00
Alexey Milovidov	2ca6952deb	Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams	2017-11-20 02:16:18 +03:00
Alexey Milovidov	6c8b5e29d8	Additions after merge [#CLICKHOUSE-2].	2017-11-20 00:17:58 +03:00
alexey-milovidov	fc0a51f1b9	Merge branch 'master' into fix4	2017-11-19 23:57:44 +03:00
Alexey Milovidov	60825748d4	Merge branch 'fix11' of https://github.com/proller/ClickHouse into proller-fix11	2017-11-19 22:57:28 +03:00
Alexey Milovidov	94d3b49e99	BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2].	2017-11-19 03:27:43 +03:00
Alexey Milovidov	9b92c0fecd	BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2].	2017-11-19 03:22:13 +03:00
Alexey Milovidov	f497b0c63c	BackgroundSchedulePool: miscellaneous; added TODO [#CLICKHOUSE-2].	2017-11-19 03:08:37 +03:00
Silviu Caragea	dfecd0b2f2	Merge with master	2017-11-18 10:16:06 +02:00
Alexey Milovidov	729b114c15	Removed unsupported functionality [#CLICKHOUSE-2].	2017-11-18 05:34:00 +03:00
Alexey Milovidov	076e0ae014	More clear [#CLICKHOUSE-2].	2017-11-18 00:20:28 +03:00
Alexey Milovidov	7c9ba15ba1	Style [#CLICKHOUSE-2].	2017-11-17 23:42:03 +03:00
proller	aa3dd03389	Split lib dbms to dbms + dbms_common_io	2017-11-17 22:19:49 +03:00
proller	79b3ef2f57	Merge remote-tracking branch 'upstream/master' into fix4	2017-11-17 15:31:13 +03:00
Silviu Caragea	64619c614f	Basic idea is : ... - We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads. - The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time - Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks NOTE: I did a minimum number of changes to be much simple to review the code	2017-11-17 10:58:35 +02:00
Marek Vavruša	c07b48075b	StorageKafka: fixed messages not showing when EOF is reached in current batch ... This prevents messages from being read if there's less than 16 messages to read in Kafka. Updated documentation with more detailed description.	2017-11-15 23:17:22 +03:00
alexey-milovidov	dbee90ba5b	Update ReplicatedMergeTreeBlockOutputStream.cpp	2017-11-15 23:13:10 +03:00
Alexey Zatelepin	99b2d135df	clear deduplication blocks when doing DROP PARTITION [#CLICKHOUSE-3208]	2017-11-15 23:13:10 +03:00
Alexey Milovidov	2846c7560f	Fixed wording [#CLICKHOUSE-2].	2017-11-15 22:47:49 +03:00
proller	468e2ab044	Merge remote-tracking branch 'upstream/master' into fix4	2017-11-14 14:50:19 +03:00
Alexey Milovidov	c4b4764a0a	Fixed error after merge [#CLICKHOUSE-2].	2017-11-14 03:11:33 +03:00
Nikolai Kochetov	14d2b830bb	fix build	2017-11-10 14:44:32 +03:00
Nikolai Kochetov	cdd852902d	Merge branch 'master' into catboost-models	2017-11-10 14:40:08 +03:00
Nikolai Kochetov	ad381f90e5	changed column names in catboost pool [#CLICKHOUSE-3305]	2017-11-10 14:31:02 +03:00
Nikolai Kochetov	2ae3f0b3b4	fixed tests [#CLICKHOUSE-3305] ... added aliases for catboost pool [#CLICKHOUSE-3305]	2017-11-10 14:30:48 +03:00
Alexey Milovidov	ac1b69247c	Addition to prev. revision [#CLICKHOUSE-3402].	2017-11-09 22:25:21 +03:00
Alexey Milovidov	783e812eb7	Fixed error [#CLICKHOUSE-2]	2017-11-04 19:46:14 +03:00
Alexey Milovidov	1aaff5762c	Attempt to change ext::shared_ptr_helper (incomplete) [#CLICKHOUSE-2].	2017-11-04 06:20:18 +03:00
Alexey Milovidov	fa8bcccdb9	Attempt to change ext::shared_ptr_helper (incomplete) [#CLICKHOUSE-2].	2017-11-04 00:50:22 +03:00
Nikolai Kochetov	1cee62eb0a	supported table_function in insert query [#CLICKHOUSE-3397]	2017-11-03 16:25:39 +03:00
Nikolai Kochetov	1d01d228a4	removed macro DEFINE_AST_QUERY_WITH_TABLE_AND_OUTPUT ... supported table_functions in desctibe table query [#CLICKHOUSE-3397]	2017-11-03 16:24:52 +03:00
Vitaliy Lyudvichenko	a4636f8656	Fixed incorrect INSERT into Distributed table in async mode with local replicas in a shard. #1404 [#CLICKHOUSE-2] ... Resolves #1404	2017-11-03 00:32:59 +03:00
proller	c974f0e88e	Merge remote-tracking branch 'upstream/master' into fix4	2017-11-02 17:42:36 +03:00
Vitaliy Lyudvichenko	9cf14d2c61	Remove obsolete code. [#CLICKHOUSE-2]	2017-11-02 17:35:12 +03:00
proller	e671c48a6e	Merge remote-tracking branch 'upstream/master' into fix4	2017-11-02 14:50:47 +03:00
KochetovNicolai	bfb4e8f3fe	zookeeper chroot fix (#1430) ... * added root and identity section to zookeeper configuration [#CLICKHOUSE-3031] * added root and identity section to zookeeper configuration [#CLICKHOUSE-3031] * moved root section in zookeeper configuration [#CLICKHOUSE-3031] * fixed root section in zookeeper configuration [#CLICKHOUSE-3031] * added tests [#CLICKHOUSE-3031] * replaced tabs to spaces in config files [#CLICKHOUSE-3031] * fix build [#CLICKHOUSE-3031] * added chech that root starts with '/' in zookeeper config file [#CLICKHOUSE-3031] * added comments [#CLICKHOUSE-3031] * Check if zookeeper chroot exists before start. Remove tailing slash form chroot. [#CLICKHOUSE-3400] * added starting '/' to zookeeper path in ReplicatedMergeTree	2017-11-02 01:59:27 +03:00
proller	6da4f5a661	add locks	2017-11-01 22:56:07 +03:00
proller	3b58e9cd67	Fix atomic usage	2017-11-01 20:15:05 +03:00
proller	c5dcde0c78	fix atomic usage	2017-11-01 16:58:02 +03:00
proller	9bc029ba17	Merge remote-tracking branch 'upstream/master' into fix4	2017-11-01 14:43:48 +03:00
Alexey Milovidov	6aff58c747	Added backward compatibility for tables created with wrong sampling key; fixed tiny error [#CLICKHOUSE-2].	2017-11-01 04:45:10 +03:00
proller	47eae26d75	Fix build	2017-10-31 22:19:36 +03:00
proller	6debbf819a	Merge remote-tracking branch 'origin/fix4' into fix4	2017-10-31 18:36:04 +03:00
proller	9e73e08269	wip	2017-10-31 17:40:44 +03:00
Nikolai Kochetov	554bb889ac	merged with master	2017-10-31 15:04:13 +03:00
Nikolai Kochetov	2bd2bc6191	renamed feature columns, check CatBoost pool in data directory [#CLICKHOUSE-3305] ... renamed feature columns, check CatBoost pool in data directory [#CLICKHOUSE-3305]	2017-10-31 14:50:23 +03:00
Nikolai Kochetov	9baa5b9e14	add non-feature columns as materialized to StorageCatBoostPool [#CLICKHOUSE-3305]	2017-10-31 14:50:22 +03:00
Nikolai Kochetov	d54e27cdcb	added TableFunctionCatBoostPool [#CLICKHOUSE-3305] ... fix column descriptions parsing [#CLICKHOUSE-3305]	2017-10-31 14:50:22 +03:00
Nikolai Kochetov	8ebce6ef5d	StorageCatBoostPool [#CLICKHOUSE-3305]	2017-10-31 14:50:21 +03:00
proller	bd1d699441	Merge remote-tracking branch 'upstream/master' into fix4	2017-10-30 22:30:28 +03:00
Alexey Zatelepin	f2ebffb7f0	save TO table of a materialized view to the ATTACH query [#CLICKHOUSE-2]	2017-10-30 21:39:39 +03:00
proller	723cbb310d	Merge remote-tracking branch 'upstream/master' into fix4	2017-10-30 21:19:28 +03:00
alexey-milovidov	56ef2e9196	Merge pull request #1380 from yandex/catboost-models ... Catboost models	2017-10-30 19:16:41 +03:00
proller	5d137e22eb	More atomics	2017-10-30 17:38:16 +03:00
proller	cda6473668	Merge remote-tracking branch 'upstream/master' into fix4	2017-10-30 16:45:22 +03:00
Alexey Zatelepin	141b85189e	always allow attaching tables with extended storage definition syntax [#CLICKHOUSE-3000]	2017-10-30 16:44:43 +03:00
proller	8b3d3cf56f	Merge remote-tracking branch 'upstream/master' into fix4	2017-10-30 16:19:19 +03:00
Vitaliy Lyudvichenko	4a55e5f94b	Hotfix of CREATE MATERIALIZED VIEW a TO b. [#CLICKHOUSE-2]	2017-10-30 15:14:36 +03:00
proller	b7dd5cd0ba	Merge remote-tracking branch 'upstream/master' into fix4	2017-10-30 13:42:34 +03:00
proller	956e1513c5	Merge remote-tracking branch 'upstream/master' into fix4	2017-10-30 13:22:20 +03:00
Alexey Milovidov	e36906cdf5	Fixed build [#CLICKHOUSE-2].	2017-10-28 06:59:42 +03:00
proller	ba49157f84	Merge remote-tracking branch 'upstream/master' into fix4	2017-10-28 01:06:09 +03:00
Alexey Milovidov	9e3daca437	Fixed build [#CLICKHOUSE-2].	2017-10-28 00:36:43 +03:00
Alexey Milovidov	b2892e058a	Fixed bad file name [#CLICKHOUSE-2].	2017-10-28 00:31:10 +03:00
Alexey Milovidov	5ab78c249d	Fixed build after merge [#CLICKHOUSE-2].	2017-10-28 00:18:06 +03:00
alexey-milovidov	9e200bdfd9	Merge branch 'master' into materialized-view-to	2017-10-27 23:21:27 +03:00
proller	c878af8740	Merge remote-tracking branch 'upstream/master' into fix4	2017-10-27 23:13:35 +03:00
alexey-milovidov	3b99b723d7	Merge pull request #1245 from yandex/CLICKHOUSE-3178 ... Atomic parts addition and removing	2017-10-27 23:03:33 +03:00
alexey-milovidov	b4bb6796c1	Merge pull request #1407 from yandex/CLICKHOUSE-3381 ... Ability to turn off deduplication, smart deduplication for MV	2017-10-27 23:03:25 +03:00
proller	07009d5072	Bughunt tsan	2017-10-27 18:34:26 +03:00
proller	1736d7d312	Allow build with system lib rdkafka	2017-10-27 17:40:41 +03:00
Alexey Milovidov	41c05f22be	Removed very old obsolete tests [#CLICKHOUSE-2].	2017-10-26 21:49:48 +03:00
Alexey Milovidov	6022201c26	Removed very old obsolete test [#CLICKHOUSE-2].	2017-10-26 21:38:40 +03:00
Alexey Milovidov	a27981b4ef	Get rid of double whitespaces [#CLICKHOUSE-2].	2017-10-26 21:36:23 +03:00
Vitaliy Lyudvichenko	51265506f8	Convey session setting up to inner table creation for MV. [#CLICKHOUSE-3381]	2017-10-26 18:39:56 +03:00
Vitaliy Lyudvichenko	a0d06c5ee0	Don't deduplicate a block inserted from MV if the source block is Ok. [#CLICKHOUSE-3381]	2017-10-26 17:58:00 +03:00
Nikolai Kochetov	371e234f01	changed ExternalLoader::getObjectsMap return type [#CLICKHOUSE-3305]	2017-10-26 17:26:03 +03:00
Vitaliy Lyudvichenko	602560cb2e	Update system.parts table. [#CLICKHOUSE-3178]	2017-10-26 17:20:21 +03:00
Vitaliy Lyudvichenko	483dfd1b44	Fixed "No part error" in replicated sender. [#CLICKHOUSE-3178]	2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko	397b8bcf92	Smarter parts deletion. [#CLICKHOUSE-3178]	2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko	d6ea9c3dcf	Fixed awful copypaste. [#CLICKHOUSE-3178]	2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko	b5c7eaa80e	Force data parts cleanup before repeat fetch. [#CLICKHOUSE-3178]	2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko	71833a7f0f	More correct procedure of parts deleting. [#CLICKHOUSE-3178]	2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko	db3a67a421	Add clearer RangeFiltered implementation. [#CLICKHOUSE-3178]	2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko	e2a12d1088	Introduced logic for MergeTree parts states. [#CLICKHOUSE-3178]	2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko	5787e8b257	Add state for MergeTree parts. [#CLICKHOUSE-3178] ... And Removed obsolete code.	2017-10-26 17:16:06 +03:00
Alexey Zatelepin	ec963e3397	save evaluated storage parameters in ATTACH queries [#CLICKHOUSE-3000]	2017-10-26 17:07:15 +03:00
proller	9ccba5fad1	Fix includes	2017-10-26 14:46:57 +03:00
Alexey Zatelepin	6ada6d9aa5	remove dead code [#CLICKHOUSE-2]	2017-10-26 07:53:52 +03:00
Alexey Zatelepin	01c39dcf1c	fix CREATE TABLE bugs and idiosyncrasies: [#CLICKHOUSE-3000] ... * fix segfault on ATTACH MATERIALIZED VIEW * allow only TEMPORARY TABLEs (not databases or views) * forbid choosing ENGINE for TEMPORARY tables * fix segfault on CREATE TABLE t1 AS t2 where t2 is a View	2017-10-26 07:53:52 +03:00
Alexey Milovidov	65982a1642	Fixed exception messages [#CLICKHOUSE-2].	2017-10-25 22:17:37 +03:00
proller	4ffbca2d8c	Fix warnings (#1406) ... * Log query id in executeQuery; Better type mismatch error; change format in report tool * Better log query_id * fix message * Use c++11 thread_local instaed of gcc's __thread * lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379] * Cmake: fix build without downloaded submodules (#1379) * fix * ZooKeeper: fixed stack smashing with tryGet() The tryGet() operation creates a 1MB buffer on stack. This may or may not work depending on the default stack size for threads, whether the stack protector is enabled or not, recursion depth, and the actual value size. This is probably going to slow down some ZK operations, but I don't see how else this could work reliably with the existing API. * increased timeout for test_insertion_sync_fails_with_timeout * Update CHANGELOG_RU.md * Update ZooKeeper.cpp * Fix warnings * Fixes * Dont strip debug info from asan, tsan and other builds except releases * Fix asan error causd by test 00144 * Fix empty log message (#CLICKHOUSE-3378)	2017-10-25 21:39:10 +03:00
alexey-milovidov	b5155916a8	Merge branch 'master' into materialized-view-to	2017-10-24 22:39:24 +03:00
Alexey Zatelepin	6bb34a4494	Merge branch 'master' into arbitrary-partitioning ... Conflicts: dbms/src/Storages/StorageFactory.cpp	2017-10-24 17:23:18 +03:00
Alexey Zatelepin	b6b5d1cf25	store rows count for part on disk to allow tables without fixed size columns [#CLICKHOUSE-3000]	2017-10-24 17:11:53 +03:00
alexey-milovidov	3c2155df0b	Update StorageKafka.cpp	2017-10-23 20:47:33 +03:00
alexey-milovidov	139e2080ae	Update StorageKafka.cpp	2017-10-23 20:47:33 +03:00
Marek Vavruša	3926851343	StorageKafka: use config string instead of just server name	2017-10-23 20:47:33 +03:00
Marek Vavruša	a7c391fbf7	StorageKafka: use std::vector instead of stack array for error string buffers	2017-10-23 20:47:33 +03:00
Marek Vavruša	f4c1149606	Settings: renamed schema to format_schema	2017-10-23 20:47:33 +03:00
Alexey Milovidov	c57a62611b	Removed StorageTrivialBuffer because it is underdeveloped [#CLICKHOUSE-2].	2017-10-23 20:38:56 +03:00
proller	c66228a746	Log query id in executeQuery; Better type mismatch error; change format in report tool (#1372) ... * Log query id in executeQuery; Better type mismatch error; change format in report tool * Better log query_id * fix message * Use c++11 thread_local instaed of gcc's __thread * lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379] * Cmake: fix build without downloaded submodules (#1379) * fix	2017-10-23 20:32:39 +03:00
Nikolai Kochetov	5966574405	fix timeout lock in DistributedBlockOutputStream	2017-10-23 16:47:00 +03:00
Nikolai Kochetov	3317251e2f	fix jobs flags in DistributedBlockOutputStream	2017-10-23 15:00:56 +03:00
Marek Vavruša	975a7ada42	StorageMaterializedView: allow CREATE MATERIALIZED VIEW x TO y ... This allows creation of materialized views without inner tables, using an existing table for materialized rows instead. This is useful for cases when you want to detach the materializing view, but keep the already materialized data readable, especially when the inner table is replicated.	2017-10-21 13:34:59 -07:00
Alexey Zatelepin	dd42d53856	additional help messages for extended syntax [#CLICKHOUSE-3000]	2017-10-20 23:02:55 +03:00
Alexey Zatelepin	c61d4106e8	allow loading all MergeTree settings from a query [#CLICKHOUSE-3000]	2017-10-20 21:28:45 +03:00
Alexey Zatelepin	a7c85e0c89	save index_granularity to ATTACH query if it wasn't set explicitly [#CLICKHOUSE-3000]	2017-10-20 21:28:44 +03:00
Alexey Zatelepin	1f76900500	move CREATE query rewriting for views to Interpreter [#CLICKHOUSE-2]	2017-10-20 21:28:43 +03:00
Alexey Zatelepin	75c65c7b59	use extended storage definition syntax for MergeTree engines [#CLICKHOUSE-3000]	2017-10-20 21:28:42 +03:00
Alexey Zatelepin	6b9ead4bd8	parse PARTITION BY, ORDER BY, SAMPLE BY, SETTINGS clauses in a storage definition [#CLICKHOUSE-3000]	2017-10-20 21:28:42 +03:00
Alexey Zatelepin	48dea685d0	use more typesafe AST objects in ASTCreateQuery [#CLICKHOUSE-3000]	2017-10-20 21:28:41 +03:00
Nikolai Kochetov	74a4c7508a	merged with master	2017-10-20 19:18:09 +03:00
Nikolai Kochetov	4262c00122	lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]	2017-10-19 22:52:45 +03:00
Alexey Zatelepin	e51f95872f	fix backward compatibility for new part format: [#CLICKHOUSE-3000] ... * do not write out partition and minmax index files for old MergeTreeData format * download the part from another replica if there are missing or extra files	2017-10-19 21:24:30 +03:00
Marek Vavruša	927c0f7b74	dbms: Partially revert previous change ... Instead of trying to convert long/unsigned long to Poco types, just don't use them.	2017-10-13 23:46:10 -07:00
Marek Vavruša	8a0571af24	dbms: Better fix for missing unsigned long to Poco::UInt64 alias	2017-10-13 21:39:14 -07:00
Marek Vavruša	70543200be	dbms: Fix build with clang after Poco update ... In the current version of Poco, unsigned long no longer aliases to UInt64 with LP64. The size_t aliases to unsigned long with clang, so all the uses of size_t instead of UInt64 when interacting with Poco interfaces are gone. I replaced uses with UInt64 where it makes sense, and added an overloaded function for readVarUInt() to support size_t.	2017-10-13 18:26:24 -07:00
Marek Vavruša	2ac5a743cc	dbms: fix build with OS X built-in clang ... The built-in clang doesn’t support value() for `std::experimental::optional`. It however supports dereference operator, which is basically the same thing: ``` /clickhouse/dbms/src/DataStreams/NullableAdapterBlockInputStream.cpp:83:67: error: call to unavailable member function 'value': res.insert({elem.column, elem.type, rename[i].value()}); ~~~~~~~~~~^~~~~ /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:547:17: note: candidate function has been explicitly made unavailable value_type& value() ^ /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:539:33: note: candidate function has been explicitly made unavailable constexpr value_type const& value() const ```	2017-10-13 18:12:29 -07:00
proller	4c7850fdc2	Optional kafka (#1355) ... * Zookeeper include fix * Update submodule contrib/poco * Fix zookeeper submodule ho-to-make doc * Update zookeeper submodule * Update submodule zookeeper * Fix compile with external zookeeper * Optional kafka * fix * Fix * fix	2017-10-14 03:53:01 +03:00
alexey-milovidov	9ccdb5420b	Merge branch 'master' into upstream-add-kafka	2017-10-13 23:52:42 +03:00
alexey-milovidov	adedf47715	Update StorageKafka.cpp	2017-10-13 23:18:43 +03:00
proller	49f8080e52	Small debud improvement	2017-10-13 21:44:26 +03:00
Amos Bird	f30841d5ab	Fix SummingMergeTree argument checking logic. ... This patch fixes the Nested Column Name checking logic, which allows nested columns be explicitly specified in SummingMergeTree engine.	2017-10-13 15:42:32 +03:00
Vladimir Chebotarev	1e0241e262	dbms: CompressionSettingsSelector. [#METR-21516]	2017-10-13 04:08:23 +03:00
Vladimir Chebotarev	4e313f3732	dbms: Added compression level for ZSTD. [#METR-26742]	2017-10-13 04:08:23 +03:00
Alexey Milovidov	d3d976a6fb	Misc [#CLICKHOUSE-2].	2017-10-12 23:45:55 +03:00
proller	b993667156	Try fix strange terminate (#1329) ... * Tests: External: rename --use_http => --no_http and fix * Try fix strange terminate	2017-10-12 23:42:58 +03:00
Alexey Milovidov	3a6705af0f	Improvement [#CLICKHOUSE-2].	2017-10-12 23:34:01 +03:00
Vitaliy Lyudvichenko	62ea1133dd	Disable part sendings and fetches before ALTER. [#CLICKHOUSE-3343]	2017-10-12 23:26:54 +03:00
KochetovNicolai	83925f1d5e	Fix array writing (#1314) ... * changed MergedBlockOutputStream [#CLICKHOUSE-3341] * fix build [#CLICKHOUSE-3341] * fix build [#CLICKHOUSE-3341] * fix build [#CLICKHOUSE-3341] * fix build [#CLICKHOUSE-3341] * fix build [#CLICKHOUSE-3341] * fix build [#CLICKHOUSE-3341] * fix build [#CLICKHOUSE-3341] * fix build [#CLICKHOUSE-3341] * fix build [#CLICKHOUSE-3341] * disabled checkNoMultidimensionalArrays [#CLICKHOUSE-3341] * fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341] * fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341] * fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341] * fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341] * added test [#CLICKHOUSE-3341] * fixed test [#CLICKHOUSE-3341] * refactoring and comments [#CLICKHOUSE-3341] * fix build [#CLICKHOUSE-3341] * Update ColumnArray.h	2017-10-12 23:13:26 +03:00
alexey-milovidov	c1285c7d6b	Update MergeTreeDataMerger.cpp	2017-10-12 22:28:24 +03:00
Vitaliy Lyudvichenko	cabf6d7799	Add better logging if OPTIMIZE cannot be executed. [#CLICKHOUSE-2]	2017-10-12 22:28:24 +03:00
Vitaliy Lyudvichenko	a65e8d9ffc	Less noisy logging. [#CLICKHOSUE-2]	2017-10-12 22:28:24 +03:00
Alexey Milovidov	d468473d62	Fixed FREEZE PARTITION: using only active data parts; acquire snapshot of parts [#CLICKHOUSE-3369].	2017-10-12 21:21:17 +03:00
Alexey Milovidov	4814eb7072	Whitespaces [#CLICKHOUSE-2].	2017-10-11 17:41:49 +03:00
Marek Vavruša	7fc08389c9	Storages: added Kafka table engine (read-only) ... Added a new table engine backed by Apache Kafka, it allows near real-time ingestion or ETL with exactly-once semantics. It doesn’t store any data on disk, so data must be materialized into a physical table to allow random access. Currently it only supports reading, no insertion.	2017-10-10 08:33:00 -07:00
Marek Vavruša	4fb570fa5e	IStorage: allow notification on dependency change ... This allows sending notifications to supported table engines when their dependencies change. For example, a table can be notified when a MATERIALIZED VIEW is attached to it. This is a building block for building pipelines.	2017-10-10 08:33:00 -07:00
proller	19042816c4	Fix compile with boost 1.65.1+ and clang 3.8 ( https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=222439 ) (#1325)	2017-10-06 19:26:32 +03:00
Nikolai Kochetov	61bef2adf1	added ExternalLoader [#CLICKHOUSE-3305]	2017-10-06 13:31:06 +03:00
Alexey Zatelepin	6e57272052	don't use partition value as a prefix for FREEZE PARTITION [#CLICKHOUSE-3000]	2017-09-26 20:40:02 +03:00
Alexey Zatelepin	f1a8b9bfa1	add comments [#CLICKHOUSE-3000]	2017-09-26 20:40:02 +03:00
Alexey Zatelepin	61f0b32757	forbid ALTER of partition key columns for now [#CLICKHOUSE-3000]	2017-09-26 20:40:02 +03:00
Alexey Zatelepin	1be62b567e	safeguards to protect against distinct partition values with the same partition_id [#CLICKHOUSE-3000]	2017-09-26 20:40:02 +03:00
Alexey Zatelepin	728a23f60e	allow creation of custom-partitioned tables with experimental syntax [#CLICKHOUSE-3000]	2017-09-26 20:40:02 +03:00
Alexey Zatelepin	a10ba0cd91	serialize partition key in Replicated tables metadata [#CLICKHOUSE-3000]	2017-09-26 20:40:02 +03:00
Alexey Zatelepin	909b46de0f	add MergeTreeDataFormatVersion constant [#CLICKHOUSE-3000]	2017-09-26 20:40:02 +03:00
Alexey Zatelepin	68cb592277	allow arbitrary partition literals in ALTER PARTITION queries [#CLICKHOUSE-3000]	2017-09-26 20:40:02 +03:00
Alexey Zatelepin	f0995f2741	partition serialization into id and text [#CLICKHOUSE-3000]	2017-09-26 20:40:02 +03:00
Alexey Zatelepin	25bb444d5a	absence of partitioning works [#CLICKHOUSE-3000]	2017-09-26 20:40:02 +03:00
Alexey Zatelepin	71ebf67f2e	encapsulate partition and minmax_idx load/store code [#CLICKHOUSE-3000]	2017-09-26 20:40:02 +03:00
Alexey Zatelepin	6906921932	load partition and minmax index from disk [#CLICKHOUSE-3000]	2017-09-26 20:40:02 +03:00
Alexey Zatelepin	e9f93028b8	serialize partition and minmax index values [#CLICKHOUSE-3000]	2017-09-26 20:40:02 +03:00
Alexey Zatelepin	2f80c150db	save MergeTree data format version and parse part names depending on it [#CLICKHOUSE-3000]	2017-09-26 20:40:02 +03:00
Nikolai Kochetov	322e56c692	fix reading with preferred_block_size_bytes = 0	2017-09-24 02:16:30 +03:00
Alexey Zatelepin	df58949a68	make exit out of the loop possible when ZooKeeper is unavailable [#CLICKHOUSE-3259]	2017-09-20 06:05:20 +03:00
Alexey Zatelepin	ba87fa395c	be more conservative when deleting replication queue items in PartCheckThread [#CLICKHOUSE-3258]	2017-09-20 06:05:20 +03:00
proller	0a0e04f1a5	Fix includes	2017-09-18 21:52:47 +03:00
Alexey Milovidov	86c46ad1bd	Unification [#CLICKHOUSE-2].	2017-09-15 15:16:12 +03:00
Vitaliy Lyudvichenko	826c354ff5	Fixed merges progress bar. [#CLICKHOUSE-2]	2017-09-15 01:04:13 +03:00
Vadim Skipin	e0a1e6982b	Context parameter added to the IDatabase methods	2017-09-11 21:29:26 +03:00
proller	5054d50307	Remove too noisy message (#CLICKHOUSE-3304)	2017-09-11 21:26:43 +03:00
Alexey Milovidov	cd540c2674	Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2].	2017-09-10 02:17:38 +03:00
Alexey Milovidov	5a8f47a640	Fixed not an issue, shown by TSan [#CLICKHOUSE-2].	2017-09-10 02:07:32 +03:00
Alexey Milovidov	a6d5e9c7e8	Fixed not an issue, shown by TSan [#CLICKHOUSE-2].	2017-09-10 02:04:22 +03:00
Alexey Milovidov	94b975e7f9	Removed function deprecated in C++ [#CLICKHOUSE-3174].	2017-09-09 02:31:18 +03:00
Alexey Milovidov	ed1c0820f0	Fixed minor issue found by Coverity [#CLICKHOUSE-3285].	2017-09-09 02:25:42 +03:00
Alexey Milovidov	a81028377e	Implemented some suggestions from clang-tidy (part 9) [#CLICKHOUSE-3301].	2017-09-08 08:03:21 +03:00
Alexey Milovidov	dc4976f562	Implemented some suggestions from clang-tidy (part 8) [#CLICKHOUSE-3301].	2017-09-08 07:58:57 +03:00
Alexey Milovidov	d29c77adea	Implemented some suggestions from clang-tidy (part 3) [#CLICKHOUSE-3301].	2017-09-08 06:47:27 +03:00
Alexey Milovidov	6307661c35	Addition to prev. revision [#CLICKHOUSE-3300].	2017-09-08 00:26:25 +03:00
Alexey Milovidov	8b313ab99e	Fixed warnings found by cppcheck [#CLICKHOUSE-3300].	2017-09-08 00:04:48 +03:00
Alexey Milovidov	0dcee75180	Supporessed useless false positive errors found by cppcheck [#CLICKHOUSE-3300].	2017-09-07 22:13:37 +03:00
Alexey Milovidov	d82b87aaef	Fixed redundand code in better way [#CLICKHOUSE-3281].	2017-09-06 06:24:39 +03:00
Vitaliy Lyudvichenko	d55d5eca46	Remove extra Context reference and add required ones. Part 2. [#CLICKHOUSE-3117]	2017-09-06 04:18:07 +03:00
Alexey Milovidov	48ab039501	Unify serialization of complex data types: development [#CLICKHOUSE-2838].	2017-09-05 05:36:35 +03:00
Alexey Milovidov	4d97959e57	Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams	2017-09-04 04:11:00 +03:00
Alexey Milovidov	87fab3396e	Fixed build [#CLICKHOUSE-2].	2017-09-01 21:22:03 +03:00
Alexey Milovidov	40884640a1	Merge branch 'master' of github.com:yandex/ClickHouse	2017-09-01 21:21:05 +03:00
Alexey Milovidov	2af8747164	Removed obsolete code [#CLICKHOUSE-3270].	2017-09-01 21:21:01 +03:00
alexey-milovidov	775d95888a	Merge pull request #1163 from yandex/CLICKHOUSE-2931 ... Introduce SYSTEM queries	2017-09-01 20:45:29 +03:00
Vitaliy Lyudvichenko	88c9dcbb3d	Changed method signature. [#CLICKHOUSE-3246]	2017-09-01 20:45:05 +03:00
Vitaliy Lyudvichenko	566160c048	Use FIFO lock in IStorage. [#CLICKHOUSE-3246]	2017-09-01 20:45:05 +03:00
proller	1a8e22c37f	Allow compile on 32bit systems (#1175) ... * Trying compile under 32bit.. * PerformanceTest: use getMultiple*FromConfig, fix debug helpers * Missing file * clnag-format of Split ComplexKeyCacheDictionary * wip * Requested changes * wip * wip * Fix boost 1.64 and gcc7+ compile errors * More fixes * wip * Fix arm build * wip * wip * wip * wip * wip * wip * wip * clean * fix * wip * wip * clean * clean * wip * wip * Update MergeTreeSettings.h * Requested changes * Requested changes * Requested changes * Requested changes	2017-09-01 20:21:03 +03:00
Nikolai Kochetov	937f37c489	fixed reading of empty block in prewhere [#CLICKHOUSE-3266]	2017-09-01 15:18:40 +03:00
Nikolai Kochetov	a9e2a17f69	fixed estimateNumRows in MergeTreeBlockSizePredictor; fixed reading of empty block in prewhere; added test [#CLICKHOUSE-3266]	2017-09-01 15:18:40 +03:00
Alexey Zatelepin	d2847f22af	PR fixes [#CLICKHOUSE-3000]	2017-08-31 23:32:03 +03:00
Alexey Zatelepin	61987df169	check alter of partition key columns [#CLICKHOUSE-3000]	2017-08-31 23:32:03 +03:00
Alexey Zatelepin	dc5809ed8d	get rid of unneeded variable [#CLICKHOUSE-3000]	2017-08-31 23:32:03 +03:00
Alexey Zatelepin	34ac0e0876	remove unnecessary include [#CLICKHOUSE-3000]	2017-08-31 23:32:03 +03:00
Alexey Zatelepin	14ba0a9acf	rename partition -> partition_id for clarity [#CLICKHOUSE-3000]	2017-08-31 23:32:03 +03:00
Alexey Zatelepin	645e4b7a53	generalize MinMax index [#CLICKHOUSE-3000]	2017-08-31 23:32:03 +03:00
Alexey Zatelepin	5471979f46	generic partitioning of inserted blocks [#CLICKHOUSE-3000]	2017-08-31 23:32:03 +03:00
Alexey Zatelepin	be1c62d7f8	split partition and minmax index [#CLICKHOUSE-3000]	2017-08-31 23:32:03 +03:00
Alexey Zatelepin	99969ab77a	Introduce MergeTreePartitionIndex. Isolate its loading code. [#CLICKHOUSE-3000]	2017-08-31 23:32:03 +03:00
alexey-milovidov	5d14855989	Merge branch 'master' into CLICKHOUSE-2931	2017-08-31 00:23:39 +03:00
Alexey Milovidov	495daffa16	Miscellaneous [#CLICKHOUSE-2].	2017-08-30 21:13:32 +03:00
Vitaliy Lyudvichenko	5916d823ef	Fix deadlock in case of using Buffer table with CLEAR COLUMN IN PARTITION. [#CLICKHOUSE-3238]	2017-08-30 17:34:40 +03:00
Alexey Milovidov	e4eb6f0cfb	Fixed bad translation [#CLICKHOUSE-2].	2017-08-29 22:02:07 +03:00
Alexey Milovidov	709eba2a00	Merge branch 'master' of github.com:yandex/ClickHouse	2017-08-29 21:51:58 +03:00
Alexey Milovidov	04af7a3349	Fixed bad translation [#CLICKHOUSE-2].	2017-08-29 21:51:48 +03:00
Vitaliy Lyudvichenko	84660029ec	Don't leave trash part nodes in ZK in case of deleting non-existing duplicated parts. [#CLICKHOUSE-3252]	2017-08-29 20:49:37 +03:00
Alexey Milovidov	8d7937cc30	Fixed bad translation [#CLICKHOUSE-2].	2017-08-29 17:08:25 +03:00
Vadim Skipin	4dc36893d3	Keep config in context to avoid Application singleton usages	2017-08-28 22:19:06 +03:00
Vitaliy Lyudvichenko	48f5d8f1a3	Add SYSTEM DROP DNS CACHE. [#CLICKHOUSE-2931]	2017-08-28 20:27:16 +03:00
Vitaliy Lyudvichenko	fd63277b15	Unified spelling. [#CLICKHOUSE-2]	2017-08-28 18:27:25 +03:00
Vitaliy Lyudvichenko	37820f7f64	Don't leave trash parts in ZK in case of temporary errors. [#CLICKHOUSE-3252]	2017-08-28 18:27:25 +03:00
Nikolai Kochetov	c43a13cb81	fixed async insertion into local shard of distributed [#CLICKHOUSE-3245]	2017-08-23 15:44:18 +03:00
Alexey Milovidov	e25f232b5a	Raising limit on max size for merge (step 1 of 4) [#CLICKHOUSE-2]	2017-08-19 01:56:19 +03:00
Vitaliy Lyudvichenko	e52428ddb2	Fixed SIGSEGV in CREATE TABLE AS <MV>. MV without ENGINE is forbidden! [#CLICKHOUSE-2] ... Resolves #1112 Resolves #598	2017-08-19 00:10:53 +03:00
Alexey Milovidov	e01c23267a	Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams	2017-08-18 22:41:27 +03:00
Vadim Skipin	61f65e97a8	Fix typo	2017-08-18 22:38:56 +03:00
Vitaliy Lyudvichenko	f28d0cff3c	Add more detailed exception message. [#CLICKHOUSE-3234]	2017-08-17 23:06:38 +03:00
Nikolai Kochetov	850bc9f19d	fixed reading const zero column in prewhere	2017-08-17 23:06:00 +03:00
proller	175cd99288	Freebsd fixes: fix build with libc++, fix find system lib double-conversion (#1109) ... * Cmake: Don't detect and use -no-pie flag with clang * Camke: find_unwind: Fix disable on arm * Freebsd fixes: fix build with libc++, fix find system lib double-conversion	2017-08-17 00:01:43 +03:00
Alexey Milovidov	3a86673aea	Fixed error when part could become broken during ALTER MODIFY of element of Nested column [#CLICKHOUSE-3232].	2017-08-16 22:41:52 +03:00
Alexey Milovidov	164ad05ae1	Little better [#CLICKHOUSE-3231].	2017-08-16 22:22:49 +03:00
Alexey Zatelepin	0185fd4542	fix parsing min-max dates from part name [#CLICKHOUSE-3000]	2017-08-15 23:03:59 +03:00
Alexey Zatelepin	372801c59b	fix comments [#CLICKHOUSE-3000]	2017-08-15 22:30:52 +03:00
Alexey Zatelepin	0df4ae6b02	do not use unnecessary temporary objects to query a set of parts [#CLICKHOUSE-3000]	2017-08-15 22:30:52 +03:00
Alexey Zatelepin	f25f0cd759	reduce number of places where partitioning by month is assumed [#CLICKHOUSE-3000]	2017-08-15 22:30:52 +03:00
Vitaliy Lyudvichenko	8a14cc49ff	asyncMulti() -> multi(). [#CLICKHOUSE-3221]	2017-08-15 19:18:02 +03:00
Alexey Zatelepin	3f3b7f61e2	always send changed settings for remote connections [#CLICKHOUSE-3151]	2017-08-13 12:17:09 +03:00
Alexey Zatelepin	ee457eca8a	remove shard multiplexing code, simplify [#CLICKHOUSE-3151]	2017-08-13 12:17:09 +03:00
Alexey Zatelepin	133be4d739	move and rename things [#CLICKHOUSE-3151]	2017-08-13 12:17:09 +03:00
alexey-milovidov	9b99dfb53d	Merge pull request #1031 from yandex/wait-for-insertion-in-distributed ... Wait for insertion in distributed	2017-08-11 21:35:13 +03:00
Nikolai Kochetov	24b5a59f8c	merged with remote [#CLICKHOUSE-3033]	2017-08-11 18:38:46 +03:00
Nikolai Kochetov	90940d8423	Cluster and DistributedBlockOutputStream refactoring [#CLICKHOUSE-3033]	2017-08-11 18:02:07 +03:00
Vitaliy Lyudvichenko	cd3a696d8b	Add requested changes. [#CLICKHOUSE-3207]	2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko	351a0905d5	Implemented fast block and parts cleaning. [#CLICKHOUSE-3207]	2017-08-10 23:09:05 +03:00
Alexey Milovidov	e6739cc35d	Whitespace [#CLICKHOUSE-2].	2017-08-10 22:41:21 +03:00
alexey-milovidov	4398d71ef5	Update StorageDistributed.h	2017-08-10 07:37:35 +03:00
alexey-milovidov	0282d516a4	Update DistributedBlockOutputStream.cpp	2017-08-10 07:10:36 +03:00
alexey-milovidov	2717c94a36	Update DistributedBlockOutputStream.cpp	2017-08-10 07:05:16 +03:00
alexey-milovidov	0285f99c4e	Update DistributedBlockOutputStream.cpp	2017-08-10 06:54:02 +03:00
alexey-milovidov	57a9d22b0c	Update DistributedBlockOutputStream.cpp	2017-08-10 06:49:03 +03:00
alexey-milovidov	c665c4c4e5	Update DirectoryMonitor.h	2017-08-10 06:46:16 +03:00
alexey-milovidov	5773832979	Update DirectoryMonitor.cpp	2017-08-10 06:45:57 +03:00
Alexey Milovidov	e86d0b4a74	Merge branch 'master' of github.com:yandex/ClickHouse	2017-08-10 00:07:10 +03:00
Alexey Milovidov	56a5bb53fa	Miscellaneous [#CLICKHOUSE-2].	2017-08-10 00:07:01 +03:00
Vitaliy Lyudvichenko	27174d9dd2	Avoid many checks of sending parts if sendings fail due to network error. [#CLICKHOUSE-2]	2017-08-09 23:57:42 +03:00
Nikolai Kochetov	43dc201f49	merged with master	2017-08-08 15:11:49 +03:00
Vitaliy Lyudvichenko	00ce8c9603	Add ctime caching in MergeTree's cleaner. [#CLICKHOUSE-3173]	2017-08-08 03:28:43 +03:00
Nikolai Kochetov	ea2b486735	added threadpool to DistributedBlockOutputStream	2017-08-07 23:26:28 +03:00
Alexey Milovidov	fb2aff4704	Unification of data types, that is serialized with multiple streams [#CLICKHOUSE-2838].	2017-08-07 10:31:16 +03:00
Vitaliy Lyudvichenko	10c14cfccb	Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931]	2017-08-04 17:35:36 +03:00
Nikolai Kochetov	63ec81e2e3	added threadpool for sync insertion into distributed	2017-08-03 20:42:31 +03:00
Nikolai Kochetov	0c15b2c6fc	fixed number of rows to read from first granula in mergetree	2017-08-03 15:58:04 +03:00
alexey-milovidov	ae8783aee3	Merge pull request #1045 from prog8/nocompression ... Added compression NONE	2017-08-01 23:07:52 +03:00
alexey-milovidov	2ae6f1ebdb	Update MergeTreeDataWriter.cpp	2017-08-01 23:07:16 +03:00
Pawel Rog	d6a2056851	Applied changes requested by Alexey	2017-08-01 16:48:24 +02:00
Pawel Rog	9f799820d9	Applied changes requested by Alexey	2017-08-01 10:12:15 +02:00
Alexey Milovidov	6578fb2645	Fixed error [#CLICKHOUSE-3191].	2017-08-01 00:39:24 +03:00
alexey-milovidov	d174ebc5c9	Update MergeTreeDataWriter.cpp	2017-07-31 20:44:58 +03:00
alexey-milovidov	4877aa394c	Update MergeTreeData.cpp	2017-07-31 20:44:41 +03:00
Pawel Rog	3a6c444996	Merge branch 'master' into nocompression	2017-07-31 13:36:58 +02:00
Pawel Rog	e1ab721d3d	Use compression method from configs	2017-07-31 13:12:28 +02:00
Pawel Rog	a0cc54457e	Added compression NONE	2017-07-31 12:44:45 +02:00
Nikolai Kochetov	78991b25ee	fixed preferred_max_column_in_block_size_bytes disabling	2017-07-30 01:24:57 +03:00
Alexey Milovidov	8fb452e99a	Fixed wrong log message when removing temporary part after merge, that is not byte-identical than same part on replicas; added profile event; added fail-safe logic [#MTRSADMIN-3175].	2017-07-29 00:25:24 +03:00
proller	700d4e0904	Fix boost 1.64 and gcc7+ compile errors (#1040) ... * PerformanceTest: use getMultiple*FromConfig, fix debug helpers * Missing file * clnag-format of Split ComplexKeyCacheDictionary * Requested changes * Fix boost 1.64 and gcc7+ compile errors * More fixes	2017-07-28 23:41:51 +03:00
alexey-milovidov	6917eb3153	Update MergeTreeBaseBlockInputStream.cpp	2017-07-28 22:29:40 +03:00
Nikolai Kochetov	b714d2b514	fixed column size calculation for Array column in MergeTreeReader::readRows	2017-07-28 22:29:40 +03:00
Nikolai Kochetov	d9f4f9b0f9	changed skipping rows for Array columns in MergeTreeBaseBlockInputStream	2017-07-28 22:29:40 +03:00
Alexey Milovidov	dd1f54bce2	Changed Poco::RWLock to std::shared_lock [#APRILDEV-91].	2017-07-28 20:34:02 +03:00
Alexey Milovidov	3502d36d7d	Fixed build [#CLICKHOUSE-2].	2017-07-28 02:23:13 +03:00
Nikolai Kochetov	c88e8a79cc	merged with master	2017-07-27 18:43:46 +03:00
Nikolai Kochetov	2f8f199d08	separated connection pool creation from StorageDistributedDirectoryMonitor in StorageDistributed; fixed bugs from review [#CLICKHOUSE-3033]	2017-07-27 18:24:39 +03:00
Vitaliy Lyudvichenko	515271544d	Add detail comment. [#CLICKHOUSE-3173]	2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko	445608afec	Fix an iterator pointing after std::end(). [#CLICKHOUSE-3173]	2017-07-27 11:19:20 +03:00
alexey-milovidov	73c2a1483d	Update ReplicatedMergeTreeCleanupThread.cpp	2017-07-27 11:19:20 +03:00
alexey-milovidov	dcd7354fb2	Update ReplicatedMergeTreeCleanupThread.cpp	2017-07-27 11:19:20 +03:00
alexey-milovidov	d6750880e0	Update ReplicatedMergeTreeCleanupThread.cpp	2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko	cd5bb4d921	Add replicated_deduplication_window_seconds merge_tree parameter. [#CLICKHOUSE-3173]	2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko	dcc4d3bff0	Avoid zxid overflow problem when cleaning old blocks used in the deduplication. [#CLICKHOUSE-3173]	2017-07-27 11:19:20 +03:00
Nikolai Kochetov	01a004050d	fixed MergeTreeBlockSizePredictor updating from empy block while reading	2017-07-26 20:03:09 +03:00
Alexey Milovidov	d57f5b81a4	Removed MaterializedView inheritance of View, as they are not related. Fixed error with Views [#CLICKHOUSE-3175].	2017-07-26 00:07:05 +03:00
Nikolai Kochetov	b3157aebb2	added synchronous insert into distributed table [#CLICKHOUSE-3033]	2017-07-25 22:42:36 +03:00
Vitaliy Lyudvichenko	03e5bf9471	Add support of parameters in aggregate function constructors. [#CLICKHOUSE-3084]	2017-07-25 20:04:10 +03:00
Alexey Milovidov	4a4e863f9d	Fixed warning on clang 6 [#CLICKHOUSE-2].	2017-07-25 01:44:13 +03:00
alexey-milovidov	d3159ed2c5	Merge pull request #1015 from yandex/fix-performance-after-changing-reading ... Fix performance after changing reading	2017-07-24 18:07:57 +03:00
Nikolai Kochetov	fcd50e3629	fixed comment	2017-07-24 18:06:32 +03:00
proller	57b9bcd354	Fix missing includes	2017-07-24 18:04:49 +03:00
Vitaliy Lyudvichenko	bc9ee54985	Don't throw exception in case of clearing empty part. [#CLICKHOUSE-2896]	2017-07-24 18:04:17 +03:00
Nikolai Kochetov	b55dcc9f93	cnanged comments; fixed 00443_preferred_block_size_bytes test	2017-07-24 16:59:03 +03:00
Alexey Milovidov	1e8547b3f6	Fixed regression [#CLICKHOUSE-3148].	2017-07-21 23:59:01 +03:00
Nikolai Kochetov	10bbededb0	merged with master	2017-07-21 21:10:14 +03:00
Nikolai Kochetov	bc0921a64e	added comments	2017-07-21 21:02:02 +03:00
Alexey Zatelepin	c939d2f96e	put Distributed inserts with different block structure into different batches [#CLICKHOUSE-3163]	2017-07-21 20:55:38 +03:00
Nikolai Kochetov	ca1957ab82	ignore preferred_max_column_in_block_size_bytes if zero [#CLICKHOUSE-3170]	2017-07-21 20:54:09 +03:00
Nikolai Kochetov	cc349b410e	set min block size as index granularity for max_block_size limit during reading [#CLICKHOUSE-3170]	2017-07-21 20:54:09 +03:00
Nikolai Kochetov	c64b65ee29	ignore preferred_max_column_in_block_size_bytes if zero [#CLICKHOUSE-3170]	2017-07-21 20:45:51 +03:00
Nikolai Kochetov	755d16b22d	set min block size as index granularity for max_block_size limit during reading [#CLICKHOUSE-3170]	2017-07-21 14:55:33 +03:00
Alexey Milovidov	c7b1e92522	Fixed error after merge [#CLICKHOUSE-3150].	2017-07-21 09:40:05 +03:00
alexey-milovidov	d4d266fa18	ColumnConst unification (#1011) ... * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * Fixed error in ColumnArray::replicateGeneric [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150]. * ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].	2017-07-21 09:35:58 +03:00
alexey-milovidov	1a1112d8bb	Update MergeTreeBlockReadUtils.h	2017-07-20 23:45:23 +03:00
Nikolai Kochetov	0b7439469d	fixed MergeTreeBlockSizePredictor initialization for sample block	2017-07-20 23:45:23 +03:00
Nikolai Kochetov	00ae32c946	renamed approximate_number_of_rows_in_part to number_of_rows_in_part	2017-07-20 23:45:23 +03:00
Nikolai Kochetov	e612152584	changed initialization in MergeTreeBlockSizePredictor	2017-07-20 23:45:23 +03:00
Nikolai Kochetov	2afd84c40c	fixed is_reading_finished status assignment in MergeTreeRangeReader [#CLICKHOUSE-3161]	2017-07-19 19:39:18 +03:00
Nikolai Kochetov	b5e94ede62	fixed is_reading_finished status assignment in MergeTreeRangeReader [#CLICKHOUSE-3161]	2017-07-19 16:44:46 +03:00
Alexey Milovidov	6e6e9f9d38	Removed useless variable [#CLICKHOUSE-3161].	2017-07-19 04:05:39 +03:00
Nikolai Kochetov	7e293df9af	merged with master	2017-07-17 22:48:22 +03:00
Nikolai Kochetov	eae94edd6b	fixed vertical merge for ReplacingSortedBlockInputStream [#CLICKHOUSE-3131]	2017-07-17 22:40:30 +03:00
Alexey Milovidov	5c3ca0c16e	Inverted dependency in DataTypeFactory [#CLICKHOUSE-3149].	2017-07-16 07:11:11 +03:00
Alexey Milovidov	17786c0e6d	Added missing file [#CLICKHOUSE-3148].	2017-07-15 07:06:51 +03:00
Alexey Milovidov	9406b6a5aa	Get rid of ASTSet, because it is not really an AST and it lead to bugs [#CLICKHOUSE-3148].	2017-07-15 06:48:36 +03:00
Nikolai Kochetov	a13423e552	added vertical merge for ReplacingSortedBlockInputStream	2017-07-14 21:17:23 +03:00
Alexey Milovidov	1a0f5dd7cf	Getting rid of ASTSet (incomplete) [#CLICKHOUSE-2]	2017-07-14 03:33:37 +03:00
Nikolai Kochetov	283810e8ab	merged with master	2017-07-13 23:59:34 +03:00
Nikolai Kochetov	75be0b81d8	removed typeid_cast from IColumn.h	2017-07-13 23:58:19 +03:00
Nikolai Kochetov	210f14aaba	renamed IDataType::updateAvgValueSizeHints to IDataType::updateAvgValueSizeHint	2017-07-13 21:54:17 +03:00
Nikolai Kochetov	f3f217b40a	fixed tests	2017-07-13 21:45:09 +03:00
Nikolai Kochetov	546012079c	fixed reading with zero max block size setting	2017-07-13 21:45:09 +03:00
Nikolai Kochetov	e2d032b883	fixed reading with zero max block size setting	2017-07-13 21:45:09 +03:00
Nikolai Kochetov	8ea812e669	better comment for MergeTreeRangeReader	2017-07-13 21:45:09 +03:00
Nikolai Kochetov	f232afd2f8	round number of rows to nearest mark in MergeTreeBaseBlockInputStream	2017-07-13 21:45:09 +03:00
Nikolai Kochetov	f1775af3f0	deleted commented code	2017-07-13 21:45:09 +03:00
Nikolai Kochetov	30ed774bf7	refactoring and more comments in MergeTreeBaseBlockInputStream [#CLICKHOUSE-3065]	2017-07-13 21:45:09 +03:00
Nikolai Kochetov	89386394aa	refactoring and more comments in MergeTreeBaseBlockInputStream [#CLICKHOUSE-3065]	2017-07-13 21:45:09 +03:00
Nikolai Kochetov	8c65d6013e	added preferred_max_column_in_block_size_bytes setting, added filtration ratio prediction [#CLICKHOUSE-3065]	2017-07-13 21:45:09 +03:00
Nikolai Kochetov	4470afc9a9	added estimateNumRowsMax to MergeTreeBlockSizePredictor based on max column size	2017-07-13 21:45:09 +03:00
Nikolai Kochetov	6b29b3bd47	round number of rows to next mark in MergeTreeBaseBlockInputStream	2017-07-13 21:45:09 +03:00
Nikolai Kochetov	d14f64af7b	delected commented logging code	2017-07-13 21:45:09 +03:00
Nikolai Kochetov	586dff9126	delay reading for granulas if prewhere column is false during partial granula reading	2017-07-13 21:45:09 +03:00
Nikolai Kochetov	86680f5513	fixed partial granula reading for const columns in prewhere	2017-07-13 21:45:09 +03:00
Nikolai Kochetov	609711b20c	partial part reading with prewhere	2017-07-13 21:45:09 +03:00
Nikolai Kochetov	c6d5ef6d30	added MergeTreeRangeReader	2017-07-13 21:45:09 +03:00
Nikolai Kochetov	985e449bd3	added IDataType::updateAvgValueSizeHints; renamed PODArray::allocated_size to PODArray::allocated_bytes; renamed renamed IColumn::allocatedSize to IColumn::allocatedBytes; removed IColumn.h from IDataType.h	2017-07-13 19:49:09 +03:00
Alexey Milovidov	7068d1ff81	Using lexer (incomplete) [#CLICKHOUSE-2].	2017-07-13 08:59:01 +03:00
Alexey Milovidov	de75fa000b	Using lexer (incomplete) [#CLICKHOUSE-2].	2017-07-13 08:59:01 +03:00
Alexey Milovidov	83c8043193	Using lexer (incomplete) [#CLICKHOUSE-2].	2017-07-13 08:59:01 +03:00
Alexey Milovidov	1bab7fc344	Using lexer (incomplete) [#CLICKHOUSE-2].	2017-07-13 08:59:01 +03:00
Alexey Milovidov	4b1eeee1a3	Using lexer (incomplete) [#CLICKHOUSE-2].	2017-07-13 08:59:01 +03:00
Alexey Milovidov	5b5795633e	Using lexer (incomplete) [#CLICKHOUSE-2].	2017-07-13 08:59:01 +03:00
Nikolai Kochetov	1cf669cc0a	made collectIdentifiersInFirstLevelOfSelectQuery static	2017-07-12 21:51:51 +03:00
Nikolai Kochetov	5ed5e8c75d	moved getRequestedColumns to StorageMerge::collectIdentifiersInFirstLevelOfSelectQuery	2017-07-12 21:51:51 +03:00
Nikolai Kochetov	5924b13f4c	fixed unnecessary columns removing for merge table on distibuted	2017-07-12 21:51:51 +03:00
Alexey Zatelepin	58d541b740	slightly more robust ReplicatedMergeTreePartCheckThread::TemporarilyStop [#CLICKHOUSE-3074]	2017-07-12 20:09:44 +03:00
Alexey Zatelepin	bdc529645e	fix cyclical yielding of leadership at startup [#CLICKHOUSE-3074]	2017-07-12 20:09:44 +03:00
Vitaliy Lyudvichenko	b843ea5b3f	Resolves #964. Fixed input_format_skip_unknown_fields for negative numbers. [#CLICKHOUSE-3]	2017-07-11 21:36:51 +03:00
Nikolai Kochetov	ee66169d5e	added throw_if_column_not_found to FilterColumnsBlockInputStream [#CLICKHOUSE-3111]	2017-07-11 20:58:49 +03:00
Alexey Zatelepin	57ba50f585	allow batching Distributed inserts [#CLICKHOUSE-3126]	2017-07-11 20:56:17 +03:00
Alexey Zatelepin	4a98d83a3b	introduce replicated_can_become_leader merge_tree setting [#CLICKHOUSE-3109]	2017-07-11 20:44:35 +03:00
Alexey Milovidov	2bd84600d1	Miscellaneous [#CLICKHOUSE-2].	2017-07-11 04:20:40 +03:00
Alexey Milovidov	86eb4d2d06	Renamed Singleton to avoid conflicts with Arcadia* codebase [#DEVTOOLS-3343]. ... * - "Arcadia" is the name of Yandex's monorepo.	2017-07-10 07:34:14 +03:00
alexey-milovidov	b64b243a73	Merge pull request #945 from YiuRULE/master ... Implement natively uuid type in Clickhouse	2017-07-10 07:00:45 +03:00
Alexey Milovidov	119961133c	Removed obsolete test [#CLICKHOUSE-3].	2017-07-10 06:47:20 +03:00
Alexey Milovidov	bf58b8cdb1	Fixed test [#CLICKHOUSE-3].	2017-07-10 06:45:04 +03:00
Alexey Zatelepin	89939a685a	Stream row sources from disk for vertical merge [#CLICKHOUSE-3118]	2017-07-09 21:57:06 +03:00
Marek Vavruša	ff73394124	PKCondition: infer index use with pk subexpression ... By default only constraints explicitly matching primary key expression (or expression wrapped in a monotonic function) are eligible for part and range selection. So for example, if index is: (toStartOfHour(dt), UserID) Then a query such as this resorts to full scan: SELECT count() FROM t WHERE dt = now() Intuitively, only parts with toStartOfHour(now()) could be selected, but it is less trivial to prove. The primary key currently can be wrapped in a chain of monotonic functions, so following would work: toStartOfHour(dt) = toStartOfHour(now()) AND dt = now() It must be however explicitly stated, if we wanted to infer that we’d have to know the inverse function, and prove that the inverse function is monotonic on given interval. This is not practical as there is no inverse function that for example undos rounding, it isn’t strictly monotonic. There are however functions that don’t transform output range and preserve monotonicity on the complete input range, such as rounding or casts to a same or wider numeric type. This eliminates the need to find inverse function, as no check for monotonicity over arbitrary interval is needed, and thus makes this optimisation possible.	2017-07-09 17:13:51 +03:00
Nikolai Kochetov	f1ec4cd863	added FilterColumnsBlockInputStream into StorageMerge [#CLICKHOUSE-3111]	2017-07-05 20:14:17 +03:00
Alexey Milovidov	66638c4158	Fixed error in StorageDictionary [#CLICKHOUSE-2].	2017-07-05 19:36:45 +03:00
Guillaume Tassery	aeeb81fadf	Rename field in UInt128	2017-07-04 18:10:36 +02:00
Alexey Milovidov	032d12d431	Fixed translation error [#CLICKHOUSE-2].	2017-07-04 15:46:31 +03:00
Guillaume Tassery	cba9815981	Change Uuid to UUID datatype and make UInt128 a generic type	2017-07-04 12:42:53 +02:00
Alexey Milovidov	727ce48c23	Fixed error with selecting number of threads for distributed query processing [#CLICKHOUSE-3115].	2017-07-04 00:04:10 +03:00
Guillaume Tassery	525851ec68	sync master	2017-06-30 22:21:42 +02:00
Guillaume Tassery	1231952fca	Implement UUID type and toUuid function	2017-06-30 22:01:27 +02:00
Alexey Zatelepin	9de4d8facb	allow loading missing setting from config [#CLICKHOUSE-3091]	2017-06-28 19:56:35 +03:00
Alexey Zatelepin	7cf413dea8	Revert "Raised up limit on max size of parts to merge [#CLICKHOUSE-3091]." ... This reverts commit 425156e32c.	2017-06-28 15:32:52 +03:00
Vitaliy Lyudvichenko	97f7b46ebd	Fixed CLEAR COLUMN test in case of deduplication rollback. [#CLICKHOUSE-2]	2017-06-26 19:34:38 +03:00
Vitaliy Lyudvichenko	9c0da6e698	Addition to previous commit. Fix error code, rename test tables. [#CLICKHOUSE-2]	2017-06-26 17:35:26 +03:00
Vitaliy Lyudvichenko	49cbc33a6b	Fix ZK exception in case of concurrent INSERTs in new partition. [#CLICKHOUSE-2]	2017-06-26 17:21:25 +03:00
Vitaliy Lyudvichenko	b53d6976b3	Fix build after merge. [#CLICKHOUSE-2]	2017-06-26 15:47:15 +03:00
Alexey Milovidov	a48a21f593	Merge branch 'master' into CLICKHOUSE-2896	2017-06-26 11:54:58 +03:00
alexey-milovidov	e122cf0bcf	Merge pull request #914 from yandex/database-dictionary ... DatabaseDictionary	2017-06-25 22:02:45 +03:00
Alexey Milovidov	8f145da1e8	Preparation [#CLICKHOUSE-2].	2017-06-25 06:43:59 +03:00
Alexey Milovidov	dbc61a6a43	Added support for SQL-style quoting [#CLICKHOUSE-20].	2017-06-25 06:43:37 +03:00
Alexey Milovidov	275a1d4651	Improvement [#CLICKHOUSE-3091].	2017-06-25 05:48:38 +03:00
Alexey Milovidov	90a1ae1062	Fixed error in prev. revision [#CLICKHOUSE-3091].	2017-06-25 05:22:10 +03:00
Alexey Milovidov	516b095423	Fixed error in prev. revision [#CLICKHOUSE-3091].	2017-06-25 04:54:25 +03:00
Alexey Milovidov	8228acd3ea	Removed obsolete code that was relevant only in extremely rare case of transforming CollapsingMergeTree to ReplicatedCollapsingMergeTree through ATTACHing data parts and while some considerations about data order in table is important [#CLICKHOUSE-3091].	2017-06-25 03:51:51 +03:00
Alexey Milovidov	3c660fd65b	Fixed translation errors [#CLICKHOUSE-3091].	2017-06-25 03:17:08 +03:00
Alexey Milovidov	28e9e06992	Preparation: locking block number only after write to filesystem; removed obsolete code [#CLICKHOUSE-3091].	2017-06-25 03:01:10 +03:00
Alexey Milovidov	c7f35997f5	Removed unused variable [#CLICKHOUSE-2].	2017-06-25 01:36:43 +03:00
proller	4db8d09de9	Reorganize includes. part 1 (#921) ... * Make libunwind optional. Allow use custom libcctz * fix * Fix * fix * Update BaseDaemon.cpp * Update CMakeLists.txt * Reorganize includes. part 1 * Update dbms_include.cmake * Reorganize includes. part 2 * Reorganize includes. part 3 * dbms/src/Common/ThreadPool -> libs/libcommon * Reorganize includes. part 4 * Fix print_include_directories * Update thread_creation_latency.cpp * Update StringRef.h	2017-06-23 23:22:35 +03:00
Nikolai Kochetov	adb632319d	DatabaseDictionary creates new storage for every create table query; drop table works untill restart	2017-06-23 18:55:45 +03:00
Alexey Milovidov	061c214c16	Fixed error [#CLICKHOUSE-3074].	2017-06-23 09:57:55 +03:00
Alexey Milovidov	f409cad0ac	Miscellaneous [#CLICKHOUSE-3091].	2017-06-23 09:18:00 +03:00
Alexey Milovidov	7d732343eb	Fixed error in prev. revision [#CLICKHOUSE-3091].	2017-06-22 22:52:06 +03:00
Alexey Milovidov	425156e32c	Raised up limit on max size of parts to merge [#CLICKHOUSE-3091].	2017-06-22 21:29:40 +03:00
Alexey Milovidov	6eb06774d3	Addition to prev. revision [#CLICKHOUSE-3091].	2017-06-22 19:29:15 +03:00
Alexey Milovidov	c96719685c	Lowered max_delay_to_insert to one second, because higher values are non practical and could be harmful for usual failover logic in client apps [#CLICKHOUSE-3091].	2017-06-22 19:17:01 +03:00
Alexey Milovidov	941c281221	Updated comment [#CLICKHOUSE-3091].	2017-06-22 19:09:03 +03:00
Alexey Milovidov	22e7070fb0	Merge branch 'master' of github.com:yandex/ClickHouse	2017-06-22 19:07:57 +03:00
Alexey Milovidov	bb7fc04e2b	Whitespaces [#CLICKHOUSE-2].	2017-06-22 19:07:52 +03:00
Nikolai Kochetov	4c114bc3a1	added DatabaseDictionary	2017-06-22 18:44:19 +03:00
Vitaliy Lyudvichenko	d7db235269	Better names and log messages. [#CLICKHOUSE-2896]	2017-06-22 18:32:09 +03:00
Vitaliy Lyudvichenko	99f502d5e0	Support OPTIMIZE query on non-leader replica. [#CLICKHOUSE-2]	2017-06-22 18:01:08 +03:00
proller	51b41aa0e3	Fix build	2017-06-22 17:14:13 +03:00
Vitaliy Lyudvichenko	eff3588f28	Rename DROP COLUMN FROM PARTITION -> CLEAR COLUMN IN PARTITION. [#CLICKHOUSE-2896]	2017-06-22 16:18:19 +03:00
Alexey Milovidov	4af5a9c7ba	Merge branch 'cache_parts_that_cannot_be_merged'	2017-06-22 03:56:44 +03:00
Alexey Milovidov	946c275dfb	Added missing case for broken files in StorageDistributed [#CLICKHOUSE-3091].	2017-06-22 03:56:17 +03:00
Alexey Milovidov	db546dc827	Caching parts that cannot be merged for some time [#CLICKHOUSE-3091].	2017-06-22 03:28:44 +03:00
Vitaliy Lyudvichenko	53adb891b3	Add replicated DROP COLUMN FROM partition for optimistic case. [#CLICKHOUSE-2896]	2017-06-22 00:56:38 +03:00
Alexey Milovidov	7bdc87adf0	Loosened threshold on broken parts in filesystem [#CLICKHOUSE-3076].	2017-06-21 22:11:11 +03:00
Alexey Milovidov	5c322f5756	Loosened threshold on amount of replica inconsistency to refuse server startup [#CLICKHOUSE-3076].	2017-06-21 22:07:08 +03:00
Alexey Milovidov	6df5d556e5	Changed namespace [#DEVTOOLS-3381].	2017-06-21 11:35:38 +03:00
Alexey Milovidov	604de2bfeb	Better [#DEVTOOLS-3381].	2017-06-21 04:24:05 +03:00
Vitaliy Lyudvichenko	534b766250	CREATE of MergeTree checks that data dir is empty. [#CLICKHOUSE-3083]	2017-06-20 10:49:18 +03:00
Vitaliy Lyudvichenko	a098fb170a	Avoid creating multiple global Context. [#CLICKHOUSE-3083]	2017-06-20 10:49:18 +03:00
Георгий Кондратьев	47161f8425	Specify all link dependencies [#DEVTOOLS-3381] ... Tested with: export LDFLAGS="-Wl,--no-undefined" cmake -DUSE_STATIC_LIBRARIES=OFF -DBUILD_SHARED_LIBS=ON	2017-06-20 00:53:12 +03:00
Alexey Milovidov	05accbdcbe	Removed cyclic dependency [#DEVTOOLS-3381].	2017-06-19 23:06:35 +03:00
Alexey Milovidov	401d922a4b	Tiny modifications [#CLICKHOUSE-3044].	2017-06-18 09:11:49 +03:00
Alexey Milovidov	d64f2beaf8	Fixed build [#CLICKHOUSE-3044].	2017-06-18 08:43:29 +03:00
Alexey Zatelepin	3c6b278b3d	fix infinite recursion in StorageMerge::isRemote() [#CLICKHOUSE-2911]	2017-06-16 19:19:15 +03:00
Alex Zatelepin	4cd9df27ab	fix infinite loop in StorageMerge::isRemote() [#CLICKHOUSE-2911]	2017-06-16 03:21:00 +03:00
alexey-milovidov	43a18b164d	Merge pull request #883 from yandex/fix-merge-global-in ... Fix GLOBAL IN for Merge table over Distributed tables	2017-06-15 23:09:51 +03:00
Alexey Zatelepin	8ee85e6440	calculate isRemote() from underlying tables of StorageMerge [#CLICKHOUSE-2911]	2017-06-15 22:24:59 +03:00
Vitaliy Lyudvichenko	63ac609e8b	Avoid overestimation of avg. column element size. [#CLICKHOUSE-3058]	2017-06-15 20:33:03 +03:00
alexey-milovidov	a669136ac2	Merge branch 'master' into CLICKHOUSE-5	2017-06-13 07:30:36 +03:00
alexey-milovidov	e03ae570f7	Merge pull request #763 from yandex/storage-dictionary ... Storage dictionary	2017-06-13 07:20:46 +03:00
Vitaliy Lyudvichenko	49eab81d9a	Fix: ReshardingWorker doesn't finish if ZooKeeper session expired. [#CLICKHOUSE-2]	2017-06-13 07:15:25 +03:00
Alexey Milovidov	43fedfecea	Get rid of INSERT ID [#CLICKHOUSE-31].	2017-06-13 07:13:20 +03:00
Alexey Milovidov	45c76803a9	Moved table functions to separate library; fixed errors; improved testability [#CLICKHOUSE-31].	2017-06-10 12:04:31 +03:00
Alexey Milovidov	d5ca92093a	Fixed comment [#CLICKHOUSE-2].	2017-06-10 08:30:07 +03:00
Nikolai Kochetov	679cccc52d	renamed *.hpp to *.h in DictionaryBlickInputStream	2017-06-08 16:35:35 +03:00
Nikolai Kochetov	bff77d1bae	merged with master	2017-06-08 15:00:11 +03:00
Alexey Milovidov	38885d00a3	Merge branch 'storage-startup-method'	2017-06-07 02:27:16 +03:00
Alexey Milovidov	dc0d5b604f	Addition to prev. revision [#CLICKHOUSE-2].	2017-06-06 22:06:44 +03:00
Alexey Milovidov	50b84fcc9d	Removed duplicate code [#CLICKHOUSE-2].	2017-06-06 21:48:38 +03:00
Alexey Milovidov	0d7d379b44	Removed duplicate code [#CLICKHOUSE-2].	2017-06-06 21:36:13 +03:00
Alexey Milovidov	9c5ddce06d	Get rid of .hpp files [#CLICKHOUSE-2].	2017-06-06 20:18:32 +03:00
Alexey Milovidov	9ebf0b633f	Added IStorage::startup method to avoid starting replication and merging threads too early during server startup [#CLICKHOUSE-2].	2017-06-06 20:06:14 +03:00
Alexey Milovidov	153693cd4c	Non significant modifications [#CLICKHOUSE-3].	2017-06-05 23:43:23 +03:00
Vitaliy Lyudvichenko	1e4906816c	Avoid SIGSEGV in SystemLog destructors. [#CLICKHOUSE-3023]	2017-06-05 17:25:10 +03:00
Alexey Milovidov	8fb0afe74e	Fixed build of tests [#CLICKHOUSE-2].	2017-06-02 22:35:37 +03:00
alexey-milovidov	147b2f62b2	Update StorageReplicatedMergeTree.cpp	2017-06-02 20:02:59 +04:00
alexey-milovidov	12e6024abd	Update StorageReplicatedMergeTree.h	2017-06-02 20:02:59 +04:00
Vitaliy Lyudvichenko	6bddd4c1c5	Clean incomplete part nodes in ZooKeeper. [#CLICKHOUSE-3040]	2017-06-02 20:02:59 +04:00
Alexey Milovidov	ba499585cd	Merge branch 'master' of github.com:yandex/ClickHouse	2017-06-02 18:54:43 +03:00
Alexey Milovidov	80080f1ad6	Small refinements [#CLICKHOUSE-2].	2017-06-02 18:54:39 +03:00
Vitaliy Lyudvichenko	3a2c1a195d	Add ZooKeeper session recovering and trashy integration test. [#CLICKHOUSE-5]	2017-06-01 13:49:20 +03:00
Vitaliy Lyudvichenko	9fd8d6b79f	Add ALTER queries. [#CLICKHOUSE-5]	2017-06-01 13:49:20 +03:00
Vitaliy Lyudvichenko	209015574f	Workable version for CREATE DROP w/o ZK tests. [#CLICKHOUSE-5]	2017-06-01 13:49:20 +03:00
Nikolai Kochetov	d606436023	using MergeTreeDataPartChecksums to calculate marks_size in system.parts	2017-05-31 20:54:40 +04:00
Nikolai Kochetov	c58e98b607	added marks_size column in system.parts	2017-05-31 20:54:40 +04:00
Vitaliy Lyudvichenko	1a4b0eb355	Remove tmp part directories on server start. [#CLICKHOUSE-3044]	2017-05-31 18:01:25 +03:00
Nikolai Kochetov	7c736b12ef	added raw serialization functions for IColumn; changed key serialization in ComplexKeyCacheDictionary; style fixes	2017-05-29 20:26:45 +03:00
Nikolai Kochetov	787bf12572	merged with master	2017-05-29 20:23:14 +03:00
Alexey Milovidov	fa64d14f26	More readable temporary part names [#CLICKHOUSE-2].	2017-05-26 03:47:06 +03:00
Alexey Milovidov	ed44304c49	Removed obsolete commented code [#CLICKHOUSE-2].	2017-05-26 03:43:35 +03:00
alexey-milovidov	c79ebc586d	Merge pull request #825 from yandex/CLICKHOUSE-2989 ... Separate dirs for different part sources, fix RC during replicated alters	2017-05-26 04:42:03 +04:00
Alexey Milovidov	d35a586af2	Fixed deadlock when using executable dictionary source with cache or complex_key_cache layout [#CLICKHOUSE-3039].	2017-05-25 23:59:14 +03:00
alexey-milovidov	72822714c3	Merge branch 'master' into CLICKHOUSE-2989	2017-05-25 21:04:37 +04:00
Vitaliy Lyudvichenko	1e29795cf9	Fix race condition between cleanup and fetch thread. [#CLICKHOUSE-2989] ... It was happening during ALTERs. TODO: stop fetches during ALTER.	2017-05-25 13:08:52 +03:00
Alexey Zatelepin	e9f8f99e06	Correct index comparisons in case constants cannot be precisely casted [#CLICKHOUSE-3002]	2017-05-25 05:34:26 +04:00
Alexey Milovidov	a77369d082	Preparation: Storages do not modify query [#CLICKHOUSE-31].	2017-05-25 04:12:41 +03:00
Alexey Milovidov	557c3dc7f4	Preparation: removed support for unreplicated data in Replicated tables [#CLICKHOUSE-31].	2017-05-25 00:38:56 +03:00
Alexey Milovidov	48f65e9097	Preparation: untangling [#CLICKHOUSE-31].	2017-05-25 00:06:29 +03:00
Vitaliy Lyudvichenko	d9637c2980	MergeTreeDataPart refactoring. [#CLICKHOUSE-2989] ... Use relative_path to store actual part path. Use renameTo() to move parts.	2017-05-24 23:23:58 +03:00
Vitaliy Lyudvichenko	5618234ee8	Separate tmp part dirs for merges, fetches and inserts. [#CLICKHOUSE-2989]	2017-05-24 23:23:58 +03:00
Alexey Milovidov	8d570e2768	Renamed column "default_type" to "default_kind" in system.columns table to avoid ambiguity [#CLICKHOUSE-2].	2017-05-24 22:54:25 +03:00
Alexey Milovidov	0dd71e32e0	Preparations, part 8 [#CLICKHOUSE-31].	2017-05-23 23:04:42 +03:00
Alexey Milovidov	2b20eca06b	Preparations, part 4: StorageDistributed is initialized with const Context [#CLICKHOUSE-31].	2017-05-23 21:37:14 +03:00
Alexey Milovidov	ce581bbf35	Preparations, part 3 [#CLICKHOUSE-31].	2017-05-23 21:33:48 +03:00
Nikolai Kochetov	45c1beca2a	Merge branch 'master' into storage-dictionary	2017-05-23 13:44:03 +03:00
Alexey Milovidov	0c416be381	More simple code; fixed translation error [#CLICKHOUSE-2].	2017-05-23 04:09:47 +03:00
Alexey Milovidov	734b240490	TrivialBuffer: fixed build after merge [#CLICKHOUSE-2929].	2017-05-22 19:46:33 +03:00
Alexander Makarov	55bfaca662	StorageTrivialBuffer: added support for the replication [#CLICKHOUSE-2929]	2017-05-22 18:40:11 +04:00
Alexander Makarov	fdd636a785	fixup #2: comments on English, proper classname, StorageFactory update and merging in 'flush' method without lock [#CLICKHOUSE-2929]	2017-05-22 18:40:11 +04:00
Alexander Makarov	f8e19de0e3	fixups after review [#CLICKHOUSE-2929]	2017-05-22 18:40:11 +04:00
alexey-milovidov	90e1767387	Update TrivialBuffer.cpp	2017-05-22 18:40:11 +04:00
alexey-milovidov	2fdb7057ba	Update TrivialBuffer.cpp	2017-05-22 18:40:11 +04:00
alexey-milovidov	10f188708b	Update TrivialBuffer.h	2017-05-22 18:40:11 +04:00
alexey-milovidov	84040d8a85	Update TrivialBuffer.cpp	2017-05-22 18:40:11 +04:00
alexey-milovidov	1059c87828	Update TrivialBuffer.h	2017-05-22 18:40:11 +04:00
alexey-milovidov	3d009d153d	Update TrivialBuffer.cpp	2017-05-22 18:40:11 +04:00
alexey-milovidov	4cb799307b	Update TrivialBuffer.h	2017-05-22 18:40:11 +04:00
alexey-milovidov	fd1403d4c4	Update TrivialBuffer.cpp	2017-05-22 18:40:11 +04:00
Alexander Makarov	dfabe90373	TrivialBuffer implementation [#CLICKHOUSE-2929]	2017-05-22 18:40:11 +04:00
Alexey Milovidov	0f252046ca	Preparations [#CLICKHOUSE-2]	2017-05-22 01:25:25 +03:00
Vitaliy Lyudvichenko	45c1856556	Fix wrong implementation of CastTypeBlockInputStream (#807) ... * Fix wrong implementation of CastTypeBlockInputStream. [#CLICKHOUSE-2957] * Fix typos and add comments. [#CLICKHOUSE-2957]	2017-05-20 18:47:40 +04:00
Alexey Zatelepin	9c6829e982	Fix replica delay counting in case of ZooKeeper communication problems [#CLICKHOUSE-2141]	2017-05-20 17:32:00 +04:00
Vitaliy Lyudvichenko	bbe2a656cd	Fixed preferred_block_size_bytes in case of PREWHERE with non-materialized column. [#METR-25237]	2017-05-20 17:30:59 +04:00
Vitaliy Lyudvichenko	1d00f45dd3	Detect race condition between fetches and merges of the same part. [#CLICKHOUSE-2989]	2017-05-17 21:44:16 +04:00
Nikolai Kochetov	16256503ec	merged with master	2017-05-16 13:03:06 +03:00
Nikolai Kochetov	427c020140	deleted dictionary ptr from StorageDictionary	2017-05-15 16:58:40 +03:00
alexey-milovidov	e7b7f6f73d	Update MergeTreeData.cpp	2017-05-15 10:34:40 +04:00
Vitaliy Lyudvichenko	6262fc8650	Fix inccorect columns size in MergeTreeData after ALTER. [#CLICKHOUSE-2]	2017-05-15 10:34:40 +04:00
f1yegor	c252863b2e	translate comments	2017-05-14 19:03:55 +04:00
Alexey Milovidov	282a395464	Fixed test [#CLICKHOUSE-2].	2017-05-13 00:03:01 +03:00
Alexey Milovidov	3819216085	StorageBuffer: explicitly disable support for PREWHERE, because possibility of wrong query results [#CLICKHOUSE-2999].	2017-05-12 17:02:24 +03:00
Vitaliy Lyudvichenko	021e37943e	More clearer code and correct test. [#CLICKHOUSE-1993]	2017-05-12 16:44:11 +03:00
Vitaliy Lyudvichenko	0f1627691e	Don't forget to ATTACH MATERIALIZED columns. [#CLICKHOUSE-1993]	2017-05-11 18:39:12 +04:00
Alexey Milovidov	e5e8667bc9	Addition to prev. revision [#CLICKHOUSE-2].	2017-05-10 04:10:50 -04:00
Alexey Milovidov	a7b9a12759	Returned back Increment and CounterInFile, because they are still needed [#CLICKHOUSE-2].	2017-05-10 04:08:32 -04:00
Alexey Milovidov	5ca7650c86	Removed Increment and CounterInFile [#CLICKHOUSE-2].	2017-05-10 02:49:19 -04:00
Alexey Milovidov	acfe3d5028	Improved performance of inserting into StorageDistributed with very high number of shards (not tested) [#CLICKHOUSE-2].	2017-05-10 02:39:37 -04:00
Alexey Milovidov	27a324b469	Tiny modifications [#CLICKHOUSE-2].	2017-05-10 00:29:36 -04:00
Alexey Milovidov	8e5f92f025	Fixed translation errors, part 1 [#CLICKHOUSE-3].	2017-05-09 15:07:35 -04:00
proller	fac00792f9	Move most AggregateFunctions to separate lib, use AggregateFunctionFactory as singletone, rename lib storages_system->clickhouse_storages_system	2017-05-05 16:59:18 -07:00
proller	6c34f27e3b	Another freebsd fix, update freebsd build doc	2017-05-05 03:23:32 +03:00
Nikolai Kochetov	1604ce138a	changed key storage format for complex key dictionaries	2017-05-04 21:14:23 +03:00
proller	0787bd66ff	Merge: fail if cant convert columns (#753) ... * Merge: fail if cant convert columns * Merge: convert all different types, more tests * clean * clean * clean	2017-05-03 21:08:59 -07:00
alexey-milovidov	fb01ef0132	Update StorageMerge.cpp	2017-04-29 06:37:38 +03:00
proller	b2e2233a59	rename CastEnumBlockInputStream -> CastTypeBlockInputStream	2017-04-29 06:37:38 +03:00
proller	7a0854775b	Merge: Cast types on read [#CLICKHOUSE-2957]	2017-04-29 06:37:38 +03:00
Alexey Milovidov	e0b141e3eb	Do not remove temporary directory on fetch [#CLICKHOUSE-2894].	2017-04-29 01:26:39 +03:00
Vitaliy Lyudvichenko	42fcf148e2	Add column rows to system.parts table. [#CLICKHOUSE-2950]	2017-04-28 23:54:24 +03:00
Nikolai Kochetov	79564054a9	added RangeDictionaryBlockInputStream	2017-04-28 21:33:31 +03:00
Nikolai Kochetov	9243439e9b	added DictionaryBlockInputStream	2017-04-27 20:16:24 +03:00
proller	bcb230ebc6	Fix incudes, move code from daemon/OwnPatternFormatter.h	2017-04-27 08:40:27 +03:00
Nikolai Kochetov	bdf998d20f	added StorageDictionary	2017-04-25 12:10:27 +03:00
Alexey Milovidov	6f65176285	Explicitly disallow dummy data types and special Null data type to be in table declaration [#CLICKHOUSE-4].	2017-04-23 10:59:49 +03:00
proller	8cf716fa29	Functions as separate lib	2017-04-21 21:30:16 +03:00
Alexey Milovidov	110defd56f	Disabled replicated max parallel fetches/sends, because it does not work properly [#CLICKHOUSE-2960].	2017-04-20 21:38:17 +03:00
Alexey Milovidov	ee6a7ee204	Allow to disable replicated max parallel fetches/sends [#CLICKHOUSE-2960].	2017-04-20 21:37:01 +03:00
alexey-milovidov	512d86ceaf	Merge pull request #706 from yandex/lagging-replicas-failover ... Check for stale replicas when performing distributed queries	2017-04-20 21:30:02 +03:00
Alexey Milovidov	2d3e09af82	Fixed error [#CLICKHOUSE-2960].	2017-04-20 05:22:17 +03:00
Alexey Zatelepin	ba254a082e	Merge branch 'master' into lagging-replicas-failover ... Conflicts: dbms/src/Core/ErrorCodes.cpp	2017-04-19 21:31:29 +03:00
Alexey Zatelepin	485c58b039	use only ConnectionPoolWithFailover in RemoteBlockInputStream [#CLICKHOUSE-2141]	2017-04-19 20:50:17 +03:00
Alexey Milovidov	0b5645db1a	Better code for parsing part names [#CLICKHOUSE-2].	2017-04-18 23:38:07 +03:00
Alexey Milovidov	47d2ca4136	Fixed error with fetches and sends limit when queue is traversed without pause [#CLICKHOUSE-2960].	2017-04-18 23:36:19 +03:00
Alexey Milovidov	502f42a572	Fixed translation error [#CLICKHOUSE-3].	2017-04-18 22:13:12 +03:00
Alexey Zatelepin	e30dc7c254	check replica delay when getting a connection from ConnectionPoolWithFailover [#CLICKHOUSE-2141]	2017-04-17 22:51:41 +03:00
Yuri Dyachenko	51d2ffc654	fix TODO	2017-04-17 21:15:14 +03:00
Yuri Dyachenko	8fb2b7ee3d	fix zookeeper format version 4	2017-04-17 21:15:14 +03:00
alexey-milovidov	5a8344382b	Update StorageReplicatedMergeTree.cpp	2017-04-17 21:15:14 +03:00
alexey-milovidov	9d3e3675fd	Update ReplicatedMergeTreeLogEntry.h	2017-04-17 21:15:14 +03:00
alexey-milovidov	acd3c3d4ab	Update MergeTreeDataMerger.cpp	2017-04-17 21:15:14 +03:00
Yuri Dyachenko	8792c4f3ca	add 'deduplicate' flag into zookeeper 'merge' Entry	2017-04-17 21:15:14 +03:00
Yuri Dyachenko	10082f3ef4	support DEDUPLICATE option in OPTIMIZE query	2017-04-17 21:15:14 +03:00
Yuri Dyachenko	5e61448f25	add support DEDUPLICATE to MergeTreeDataMerger	2017-04-17 21:15:14 +03:00
Alexey Zatelepin	2bd089d589	start counting absolute replica delay when there are problems with queue update [#CLICKHOUSE-2141]	2017-04-17 18:06:12 +03:00
f1yegor	0b243a8b01	translate comments	2017-04-16 23:17:32 +03:00
Alexey Milovidov	676192f16e	Fixed errors on clang [#CLICKHOUSE-2902].	2017-04-15 07:03:12 +03:00
artpaul	050f1d4b0a	drop column from partition for MergeTree	2017-04-15 06:52:04 +03:00
alexey-milovidov	7fcf570c43	Update MergeTreeDataPart.cpp	2017-04-15 06:48:24 +03:00
alexey-milovidov	5a7a155ca1	Update MergeTreeBlockReadUtils.cpp	2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko	8b54e9fc65	Removed extra diagnostic log messages. [#CLICKHOUSE-2902]	2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko	848c927bb7	Fix race condition. Add test. [#CLICKHOUSE-2902]	2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko	56b00a110a	Removed debug code and add docs. [#CLICKHOUSE-2902]	2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko	c78177a28a	More accurate prediction. [#CLICKHOUSE-2902]	2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko	f519100946	Split base and derived class implementations. [#CLICKHOUSE-2902]	2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko	4b566304ca	Tests are passed. [#CLICKHOUSE-2902]	2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko	82af2278fc	Avoid code duplication near MergeTreeBlockInputStream. [#CLICKHOUSE-2] ... Add preferred_block_size_bytes for non-uniform reader. [#CLICKHOUSE-2902] Make enums test more deterministic. [#CLICKHOUSE-2] Refactored MergeTree readers. Tabs -> spaces. Move include/DB/ -> src/.	2017-04-15 06:48:24 +03:00
Alexey Zatelepin	3ca6efbbd9	substitute parse<size_t>(config.getString()) for config.getUInt64()	2017-04-12 19:37:19 +03:00
Alexey Zatelepin	eb4f895ea5	fix integer overflow [#CLICKHOUSE-2927]	2017-04-12 19:10:06 +03:00
Alexey Zatelepin	0e6c38bd63	throw exception for invalid MergeTreeSettings config values [#CLICKHOUSE-2927]	2017-04-12 18:07:58 +03:00
Alexey Zatelepin	e1c9878c34	more descriptive exception message [#CLICKHOUSE-2927]	2017-04-12 18:07:58 +03:00
Alexey Zatelepin	0b0e8fa7e1	stable column order in BufferBlockInputStream [#CLICKHOUSE-2940]	2017-04-11 21:45:41 +03:00
proller	38e9254d33	fix http methods for ReadWriteBufferFromHTTP (#675)	2017-04-11 17:13:19 +03:00
proller	72ccc69212	Debian: simpler package (#662) ... * Allow use external re2 with re2_st=re2 * fix * remove dupe * use re2_st in FunctionsStringSearch.h * fix * move files from tools/etc to debian * dont generate control * version * ok. * wip * Cmake: dont touch CMAKE_INSTALL_PREFIX * wip * works! * clean * okay * like old * wip * wip * okay * clickhouse-server-base-dbg * clean * clickhouse-server-dbg * Debian: Remove daemons * Update rules * add source/format * control clean * add watch * clean * clean * temp fix build * clean * docs * fake make_control * fix * testme * testme * add metrika package * fake metrika files	2017-04-10 20:43:30 +03:00
Alexey Milovidov	a0b9bf5e97	Moved code to cpp [#CLICKHOUSE-2].	2017-04-08 04:32:05 +03:00
proller	adba3b8e6d	delete ReadBufferFromHTTP, use ReadWriteBufferFromHTTP instead	2017-04-06 22:39:25 +03:00
proller	1bc311eefd	ReplicatedMergeTree: Max streams to send data [#CLICKHOUSE-2878] (#656) ... * ReplicatedMergeTree: Max streams to send data [#CLICKHOUSE-2878] * fix * better messages on client * change code to 429 TOO_MANY_REQUESTS * wip * better message * Update InterserverIOHandler.h * Update InterserverIOHTTPHandler.cpp * Update StorageReplicatedMergeTree.cpp	2017-04-06 16:03:23 +03:00
Alexey Milovidov	31f7fe42d6	Fool's day changed, continued [#CLICKHOUSE-3].	2017-04-05 14:52:23 +03:00
Vitaliy Lyudvichenko	74a92cb8d9	Add test for OPTIMIZE FINAL and more diagnostics. [#CLICKHOUSE-2886]	2017-04-04 15:54:21 +03:00
proller	11218b9ba5	cmake: remove hardcoded src/ in macros add_headers_and_sources	2017-04-04 15:37:04 +03:00
Alexey Milovidov	baf2e6e95b	Added 'join_use_nulls' setting to allow using NULLs as default values for non-joined rows in case of outer joins [#CLICKHOUSE-2].	2017-04-04 09:52:39 +03:00
Alexey Milovidov	310736cd7e	Moved headers and sources to same place [#CLICKHOUSE-3].	2017-04-01 12:22:42 +03:00
Alexey Milovidov	09e3134bf4	Revert "Using C++17 [#CLICKHOUSE-3]." ... This reverts commit 431a735efe.	2017-04-01 11:51:30 +03:00
Alexey Milovidov	ecb0b87bd8	Using C++17 [#CLICKHOUSE-3].	2017-04-01 11:51:30 +03:00
Alexey Milovidov	137ad95929	Changed tabs to spaces in code [#CLICKHOUSE-3].	2017-04-01 11:35:09 +03:00
Alexey Milovidov	4423420c20	Merge branch 'master' of github.com:yandex/ClickHouse	2017-03-31 19:00:42 +03:00
Alexey Milovidov	4f44445ff0	Removed all trailing whitespaces [#CLICKHOUSE-2]. find . -name '*.h' -or -name '*.cpp' -or -name '*.cmake' -or -name 'CMakeLists.txt' -or -name '*.html' -or -name '*.xml' | grep -v contrib | xargs sed -i -r -e 's/\s+$//'	2017-03-31 19:00:30 +03:00
proller	fbdcab343f	Limit fetching threads [#CLICKHOUSE-2878] (#648) ... * Max parallel fetches limit * use MergeTreeSettings.h * clean	2017-03-31 17:46:48 +03:00
Ravengg	a973e3898d	Add remove for part log (#638) ... * Add REMOVE_PART * fix * fix * fix codestyle	2017-03-28 20:18:49 +03:00
Alexey Milovidov	e6a41a0256	Fixed error with NULLs [#CLICKHOUSE-2901].	2017-03-24 07:42:36 +03:00
Vitaliy Lyudvichenko	84694ca269	Resolved #594. Select least busiest buffer for insert into StorageBuffer. [#CLICKHOUSE-2892]	2017-03-23 21:25:14 +04:00
proller	670e98fa92	allow several <graphite> targets (#603) ... * allow several <graphite> targets * fix * fix * Adjustable parts * changelog version * fix * changelog * Style fixes * attachSystemTables * config describe * fixes * fixes	2017-03-21 23:08:09 +04:00
Alexey Milovidov	c21b4c52c5	Misc [#CLICKHOUSE-3].	2017-03-21 21:39:07 +03:00
Alexey Milovidov	d3ae1267eb	Fixed error when parts of unlimited total size could be selected for merge in case of low free disk space [#CLICKHOUSE-2895].	2017-03-20 23:29:12 +03:00
proller	930ac5b2ce	move ClickHouseRevision to dbms	2017-03-16 13:51:41 +04:00
proller	28ed324702	add cmake option USE_VECTORIZED_MATH_FUNCTIONS, reorganize auto configs	2017-03-16 13:51:41 +04:00
proller	9a1169fef6	fix tests	2017-03-16 13:51:21 +04:00
Bogdan Voronin	a3ff193fe3	Add log merge for replicas	2017-03-16 00:23:02 +04:00
proller	d777cab172	link Storages/System via lib	2017-03-15 23:43:02 +04:00
proller	25caed0c03	move all attaches of system tables to attach_system_tables.cpp	2017-03-15 23:43:02 +04:00
Ravengg	b47cc72701	Fix part log (#591) ... * fix_part_log * fixed language back * add reset part_log back * reset part_log when don't need more * Fix header * fix	2017-03-14 19:58:34 +04:00
Alexey Milovidov	4e67e05835	Fixed error [#CLICKHOUSE-2].	2017-03-14 03:14:19 +03:00
Alexey Milovidov	bd34b62f4a	Avoid most of cases when server is aborted after exception 'Memory limit (for user) exceeded' [#CLICKHOUSE-2863].	2017-03-13 23:38:42 +03:00
Alexey Milovidov	f9b4b2012f	Removed zero-width spaces [#CLICKHOUSE-2].	2017-03-13 21:02:45 +03:00
Alexey Milovidov	26788e3938	Formatting [#CLICKHOUSE-2].	2017-03-13 21:01:46 +03:00
Alexey Milovidov	a6a18db6da	Merge branch 'translate/comments' of https://github.com/f1yegor/ClickHouse into f1yegor-translate/comments	2017-03-13 20:51:22 +03:00
f1yegor	401425bb89	translate comments	2017-03-12 20:18:07 +01:00
Alexey Milovidov	59613e1da4	Fixed build [#CLICKHOUSE-2882].	2017-03-12 19:09:39 +03:00
Alexey Milovidov	65beb6f961	Added support for NULLS FIRST and LAST in ORDER BY (continued) [#CLICKHOUSE-2882].	2017-03-12 16:03:07 +03:00
Alexey Milovidov	7532a1d564	Added support for NULLS FIRST and LAST in ORDER BY [#CLICKHOUSE-2882].	2017-03-12 15:56:59 +03:00
alexey-milovidov	6d5bfc8c6f	Refactoring of numeric DataTypes (#581) ... * Better code [#CLICKHOUSE-2]. * Addition to prev. revision [#CLICKHOUSE-2]. * Addition to prev. revision [#CLICKHOUSE-2]. * Addition to prev. revision [#CLICKHOUSE-2].	2017-03-12 14:13:45 +04:00
proller	b6e01cd47e	Fix isolated usage of all .h files, move some code to .cpp (#578) ... * split ColumnAggregateFunction.h * format * Allow use re2_st without cmake * use std type in find_first_symbols.h * fix ArrayEvaluator.h * include fixes * split ColumnConstAggregateFunction.h * fix StorageMaterializedView.h * split AddingDefaultBlockOutputStream.h * move CSVRowInputStream::updateDiagnosticInfo to .cpp * split ParserEnumElement.h * format * split DB/Parsers/ParserUseQuery.h * clean	2017-03-11 04:27:59 +04:00
Alexey Milovidov	caebb93995	Merge remote-tracking branch 'origin/master' into if-support-nulls ... Conflicts: dbms/include/DB/Columns/ColumnArray.h dbms/include/DB/Columns/ColumnString.h dbms/include/DB/Functions/FunctionsMiscellaneous.h	2017-03-09 07:39:45 +03:00
Alexey Milovidov	5546f7f75b	Normalized formatting [#CLICKHOUSE-3].	2017-03-09 07:26:17 +03:00
Alexey Milovidov	f9a5902e76	Support for NULLs in function if: continued [#CLICKHOUSE-2873].	2017-03-09 06:34:09 +03:00
Ravengg	b079dacfd1	Added part_log with statistics scripts (#549) ... * Added part_log * first_test * filter and hits_res * Add renamer and drawer * Add columns database and table into PartLog * Add normal way to get table_name and database_name from part * improve drawer * add stats for random size parts * Merge converter and drawer * make drawer more informative * add new data * add new data * new data * add long range stats * for checking best way * Add add_parts script * Good style for global merge * delete commented code * Fixed spaces to tabs * Note that Stopwatch is started automatically. * Style * Update StorageMergeTree.cpp * Update StorageReplicatedMergeTree.cpp * Switch act_time_ms to duration_ms * Added ability to disable part_log * fixed getPartLog * fix usage getPartLog * fix	2017-03-07 21:13:54 +04:00
artpaul	91f5e7ae5c	add priority and is_default columns [#CLICKHOUSE-2084]	2017-03-05 16:00:25 +05:00
Alexey Milovidov	a706e96bc4	Added more metrics for StorageBuffer [#CLICKHOUSE-2871].	2017-03-05 04:23:10 +03:00
artpaul	aed028eb96	remove meaningless comment	2017-03-05 04:45:35 +04:00
artpaul	76e9213141	system table with graphite configuration [#CLICKHOUSE-2084]	2017-03-05 04:45:35 +04:00
artpaul	1e13e68028	blank for system.graphite	2017-03-05 04:45:35 +04:00
proller	05e87ad7a2	fix scope_exit formatting	2017-03-04 00:10:41 +03:00
Alexey Zatelepin	7090d0861a	reinitialize primary key after ALTER [#CLICKHOUSE-2853]	2017-02-21 21:32:04 +04:00
Vitaliy Lyudvichenko	8bcb1fe970	Add support of AggregateFunction constants in VALUES and Set. [#CLICKHOUSE-2845]	2017-02-18 00:36:31 +04:00
Alexey Milovidov	354bed5bd7	Merge branch 'master' of github.com:yandex/ClickHouse	2017-02-13 19:12:46 +03:00
Alexey Milovidov	db9935337c	Misc [#CLICKHOUSE-2].	2017-02-13 19:12:34 +03:00
Alexey Milovidov	8f9b70a1d7	Style [#CLICKHOUSE-2].	2017-02-13 13:38:50 +03:00
Alexey Milovidov	bb7247993a	Merge branch 'uncompressed-size-in-system-tables'	2017-02-13 01:08:31 +03:00
Alexey Milovidov	7bf5373390	Added comments [#CLICKHOUSE-2831].	2017-02-13 01:07:38 +03:00
artpaul	f8a0f55335	#360 explicit types	2017-02-12 16:09:55 +05:00
artpaul	0c1dab92a3	#360 ordinary	2017-02-12 15:34:08 +05:00
Alexey Milovidov	c9b4a163be	Added info about uncompressed size to system.columns table [#CLICKHOUSE-2831].	2017-02-12 01:31:22 +04:00
alexey-milovidov	4593d363d1	Fix poor distributed insertion scalability (#481) ... * Fix poor scalability of INSERT into Distributed table [#CLICKHOUSE-2791]. * Fix poor scalability of INSERT into Distributed table (continued) [#CLICKHOUSE-2791]. * Misc [#CLICKHOUSE-2791]. * Fixed error [#CLICKHOUSE-2791].	2017-02-12 00:20:57 +04:00
Alexey Milovidov	30737aa7a1	Added info about uncompressed size to system.columns table [#CLICKHOUSE-2831].	2017-02-11 20:43:28 +03:00
Alexey Zatelepin	9918965c5f	Allow metadata-only ALTER of primary key columns [#CLICKHOUSE-2027]	2017-02-10 22:19:40 +04:00
Alexey Zatelepin	7b57402291	allow ALTERing Enum types in primary key columns [#CLICKHOUSE-2795]	2017-02-10 22:19:40 +04:00
Alexey Milovidov	d065087506	Fixed timeouts of ALTER [#CLICKHOUSE-2836].	2017-02-10 21:09:49 +03:00
Alexey Zatelepin	6b47ac1fc0	translate comments [#CLICKHOUSE-3]	2017-02-10 09:05:33 +04:00
Alexey Zatelepin	aace171ef6	forbid multidimensional array columns in MergeTree tables [#CLICKHOUSE-2803]	2017-02-10 09:05:33 +04:00
Alexey Zatelepin	8d001db5d5	forbid altering of date column in MergeTree engines	2017-02-10 09:05:33 +04:00
Alexey Milovidov	d95663865f	Miscellaneous [#CLICKHOUSE-2].	2017-02-09 02:56:40 +03:00
Alexey Milovidov	2e9ab88cb7	Fixed error by removal of obsolete optimization [#CLICKHOUSE-2825].	2017-02-09 00:45:19 +03:00
Vitaliy Lyudvichenko	98af273cbc	Fixed and refactored storage Merge. [#CLICKHOUSE-2758]	2017-02-07 23:43:31 +04:00
Vitaliy Lyudvichenko	76916739e2	Fixed arrayReduce. Refactoring of ObjectPool. [#CLICKHOUSE-2787]	2017-02-07 23:43:31 +04:00
artpaul	4c57c9731e	#437 encode name of default_database so it's can be passed through connection	2017-02-07 20:11:02 +04:00
proller	c51801d776	Change default user and paths [#CLICKHOUSE-2715] (#382) ... * Changing default user to clickhouse and path to /var/lib/clickhouse [#CLICKHOUSE-2715] * wip * Auto version update to [54141] * Get version from saved in cmake	2017-01-31 23:53:05 +04:00
Alexey Zatelepin	4ecfd44015	[#CLICKHOUSE-2115] PR changes: ... * do not insert produced value into the cache if the cache has been reset. * less logging * cosmetic fixes	2017-01-31 22:45:10 +04:00
Alexey Zatelepin	0fdcdd7bdb	Introduce LRUCache::getOrSet(), use it to avoid mark cache stampede [#CLICKHOUSE-2115]	2017-01-31 22:45:10 +04:00
proller	79a7e893c7	system.build_options: move generated data to cpp, dont regenerate every compile (#423) ... * system.build_options: move generated data to cpp, dont regenerate every compile * Fix linking iconv under macos and freebsd Partially Revert "Removed usage of glib [#CLICKHOUSE-2]." This reverts commit e4ff740ef1. * fix	2017-01-31 22:03:56 +04:00
Alexey Milovidov	ff54b9466d	Fixed error [#CLICKHOUSE-2191].	2017-01-28 00:46:15 +03:00
alexey-milovidov	de9bc1dc75	Text formats allow to skip errors (#407) ... * Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134 * Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134 * Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134 * Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134 * Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134 * Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134 * Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134 * Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134 * Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134 * Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134 * Added test [#CLICKHOUSE-2778].	2017-01-27 08:29:47 +04:00
Vitaliy Lyudvichenko	b1bccb0bb2	Query KILL QUERY. [#CLICKHOUSE-2120]	2017-01-27 03:59:39 +04:00
Alexey Milovidov	a106520a0d	Added requested change [#CLICKHOUSE-2191].	2017-01-27 00:51:30 +03:00
Artemkin Pavel	06d1509da1	check that sharding_key exists in the table and has numeric type (#392) ... * check that sharding_key exists in the table and has numeric type [#CLICKHOUSE-2191] * style * infer type of sharding expression [#CLICKHOUSE-2191]	2017-01-27 01:47:33 +04:00
proller	e715ddd72a	SELECT * FROM system.build_options [#METR-24175] (#398) ... * start [#METR-24175] * missing * wip * add spaces * wip * wip * fix * fix * missing * style fix	2017-01-26 02:24:36 +04:00
Alex Zatelepin	543b6ee757	ensure that all streams point to to_mark after reading even if max_rows_to_read is zero [#CLICKHOUSE-2775] (#396)	2017-01-25 23:16:31 +04:00
Alexey Zatelepin	281744667d	use common cur_mark_idx for all streams [#CLICKHOUSE-2116]	2017-01-25 00:48:58 +04:00
Alexey Zatelepin	dc1f0d96bd	add clarifying comment [#CLICKHOUSE-2116]	2017-01-25 00:48:58 +04:00
Alexey Zatelepin	f7ca39da77	translate comments [#CLICKHOUSE-3]	2017-01-25 00:48:58 +04:00
Alexey Zatelepin	32e5713822	do not load marks when reading the whole part [#CLICKHOUSE-2116]	2017-01-25 00:48:58 +04:00
Vitaliy Lyudvichenko	c9e52a5cf9	Add requested PR changes. [#CLICKHOUSE-2145] [issue #325]	2017-01-24 22:26:29 +04:00
Vitaliy Lyudvichenko	20a5ae4bc4	Add protection from accidental DROP queries. [#CLICKHOUSE-2184]	2017-01-24 22:26:29 +04:00