Commit Graph

1549 Commits

Author SHA1 Message Date
Alexander Kuzmenkov
f4da0399c0 Some MemorySanitizer fixes. 2019-09-13 14:49:29 +03:00
Amos Bird
a1310ffbe6 Split libdbms.so using object library
Now the linking time of incremental builds are around 1-2 seconds
2019-09-11 01:56:01 +08:00
filimonov
526afd44ed Make SensitiveDataMasker a singleton. (#6810)
Among other things, it is used to filter logs, which are being written even after the global server context is deinitialized, so we can't keep masker there.
2019-09-06 20:48:27 +03:00
alexey-milovidov
b2e80b0cd9
Merge branch 'master' into query_masking 2019-09-03 22:58:15 +03:00
alexey-milovidov
766dcc98ae
Update Loggers.h 2019-09-03 22:48:29 +03:00
alexey-milovidov
70c7926acf
Update Loggers.cpp 2019-09-03 22:47:48 +03:00
alexey-milovidov
7a6a6e093b
Update Loggers.cpp 2019-09-03 22:46:49 +03:00
Alexey Milovidov
ace08fa344 Merge branch 'master' into time-zone-configuration 2019-08-30 19:27:08 +03:00
Ivan
b4339f266d
Make a better build scheme (#6500)
* Fix shared build
* Major default libs refactor
* Fix build with gcc_eh
* Link all libraries as a big group.
* Use global interface library as a group
* Build capnproto using our cmake
* Use only internal libunwind
2019-08-28 23:49:37 +03:00
Alexey Milovidov
216b05b71b Fixed build 2019-08-28 21:33:24 +03:00
Alexey Milovidov
cf57a88495 Added a way to forbid static initialization of a class 2019-08-28 20:13:29 +03:00
Alexey Milovidov
d5f8e0347f Better setup of default time zone from configuration file 2019-08-28 20:11:11 +03:00
Alexey Milovidov
6d6c53d42b Style 2019-08-28 19:15:57 +03:00
Alexey Milovidov
0eec226c9a Simplify shared_ptr_helper 2019-08-26 22:07:29 +03:00
Alexey Milovidov
720bb3ac08 Added a test 2019-08-24 14:53:48 +03:00
Alexey Milovidov
d38e9ee229 Fixed "trim" functions (in progress) 2019-08-23 23:32:31 +03:00
Rafael David Tinoco
17a7cb8735 MySQL 8 integration requires previous declaration checks
C and C++ differ in the form of types being defined. While C++ structs
are defined also as new types, in C you have to explicitly typedef the
struct to have a new type.

Fir this case, it was enough to check if MySQL header was already
defined in order not to re-declare MYSQL, MYSQL_RES, MYSQL_ROW and
MYSQL_FIELD.

Signed-off-by: Rafael David Tinoco <rafaeldtinoco@ubuntu.com>
2019-08-20 09:48:50 -03:00
Ivan
a502424c33
Implement support for insertion into Kafka tables (#6012)
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
2019-08-20 14:17:57 +03:00
alexey-milovidov
f36d20915b
Merge pull request #6529 from yandex/better-signals
Better debug-ability of fault signals.
2019-08-18 16:44:54 +03:00
proller
d09c5c871b Build fixes (#6491)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
2019-08-18 01:53:46 +03:00
Alexey Milovidov
306878c7a0 Write symbolized stack trace on failure one line at a time and uncached 2019-08-18 01:39:26 +03:00
Alexey Milovidov
cf525890da Handle faults in printing stack trace 2019-08-18 00:42:47 +03:00
Alexey Milovidov
71dc0f29c2 Always print non-symbolized stack trace in addition to the full stack trace. 2019-08-18 00:27:25 +03:00
Alexey Milovidov
081f1bedc2 Allowed to use SIGPROF to print stack traces for debugging purposes 2019-08-18 00:13:38 +03:00
Alexey Milovidov
2cd669fa1d Minor improvement 2019-08-17 23:33:50 +03:00
Alexey Milovidov
048ac1dde2 Removed "already_signal_handled" guard, because it is not actual 2019-08-17 23:26:11 +03:00
Nikita Mikhaylov
845f4482aa better 2019-08-12 18:28:28 +03:00
Nikita Mikhaylov
ad5c7c0b65 done 2019-08-12 18:16:23 +03:00
Alexey Milovidov
5830526fa1 Slightly better information messages 2019-08-11 23:37:53 +03:00
alexey-milovidov
30f8529e04
Merge pull request #6325 from kreuzerkrieg/Shadow4GCC
adding -Wshadow for GCC
2019-08-10 17:29:10 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
proller
ff009a28d2 Arcadia build fixes 2019-08-09 18:42:52 +03:00
Alexey Milovidov
910e98ef02 Changed boost::filesystem to std::filesystem 2019-08-07 18:52:08 +03:00
Alexey Milovidov
c16b90a0e8 Changed separator of file and function to semicolon 2019-08-04 18:53:12 +03:00
alexey-milovidov
a0599214ef
Merge pull request #6103 from nikitamikhaylov/system_text_log
Allow to write ClickHouse text logs into system table.
2019-08-04 17:51:34 +03:00
alexey-milovidov
14671d6df8
Merge pull request #6254 from yandex/fastops
Integration with "FastOps" library. Added functions sigmoid and tanh.
2019-08-04 06:28:34 +03:00
Alexey Milovidov
d8eae1f83a Disable query profiler if we build with test coverage 2019-08-03 23:47:57 +03:00
Alexey Milovidov
b9d39f4882 Merge branch 'master' into fastops 2019-08-03 06:24:33 +03:00
Alexey Milovidov
62053314bb Fixed FPE in yandexConsistentHash 2019-08-03 01:40:28 +03:00
Nikita Mikhaylov
a9fea0314e better style 2019-08-01 13:31:29 +03:00
Alexey Milovidov
99b9d354f7 Fixed glibc compatibility 2019-08-01 06:20:54 +03:00
Nikita Mikhaylov
b21c89b4eb redudant braces 2019-08-01 00:59:26 +03:00
Nikita Mikhaylov
96e5a88a42 ; 2019-07-31 18:48:56 +03:00
Nikita Mikhaylov
593194133a lock to text_log added 2019-07-31 17:42:23 +03:00
Nikita Mikhaylov
ad4459c4a2 fixed flush_logs + added pretty function 2019-07-31 17:03:23 +03:00
alexey-milovidov
d264ec2b8c
Merge pull request #6186 from amosbird/c5
build fix
2019-07-31 06:02:05 +03:00
Nikita Mikhaylov
e06b3b17b3 some changes to log all text logs 2019-07-30 17:04:18 +03:00
Alexey Milovidov
fec6ede519 Fixed glibc-compatibility 2019-07-30 03:15:01 +03:00
Alexey Milovidov
372c4d89b2 Enabled line numbers in stack traces 2019-07-30 01:26:44 +03:00
Amos Bird
f63f763c3e build fix 2019-07-28 22:43:38 +08:00
Alexey Milovidov
45c5dd8e61 Minor modifications 2019-07-26 03:09:36 +03:00
Alexey Milovidov
f4ec18b30f Merge branch 'system_text_log' of https://github.com/nikitamikhaylov/ClickHouse into nikitamikhaylov-system_text_log 2019-07-26 01:51:19 +03:00
Alexey Milovidov
5a47b0b990 Sanity and configuration checks 2019-07-26 01:35:47 +03:00
Alexey Milovidov
673fb05a2a Disable PHDR Cache with TSan 2019-07-26 01:18:27 +03:00
Alexey Milovidov
eb2533f898 Merge branch 'master' into merge-profiler 2019-07-26 00:40:27 +03:00
alexey-milovidov
6cf80466d4
Merge pull request #6152 from yandex/aku/oom-adj
In debug version on Linux, increase OOM score.
2019-07-25 23:17:44 +03:00
alexey-milovidov
a7cbbd4e4a
Update BaseDaemon.cpp 2019-07-25 23:17:17 +03:00
Alexey Milovidov
9b8375a6ef More strict memory order just in case 2019-07-25 22:57:49 +03:00
Alexey Milovidov
472a61c1fa Updating PHDRCache after dlopen 2019-07-25 22:56:51 +03:00
Alexey Milovidov
f5c1dfc5ac Updated comment 2019-07-25 22:54:43 +03:00
Alexey Milovidov
050db07e3d Merge branch 'master' into merge-profiler 2019-07-25 22:54:22 +03:00
Alexey Milovidov
1d499bcdc0 Allow to update PHDRCache 2019-07-25 22:54:16 +03:00
Alexander Kuzmenkov
399799d838 In debug version on Linux, increase OOM score.
This way, clickhouse is killed first, and not some important service.
2019-07-25 19:09:19 +03:00
avasiliev
734da9c839
Safer interface of mysqlxx::Pool 2019-07-25 15:10:29 +03:00
chertus
50e3839157 NOT_UNBUNDLED -> UNBUNDLED 2019-07-25 13:35:57 +03:00
Alexey Milovidov
d414e7366c Fixed MSan report 2019-07-25 02:11:00 +03:00
Alexey Milovidov
796dfeb44e Better PHDR cache 2019-07-24 18:35:19 +03:00
Alexey Milovidov
cc7fe5fb8d Addition to prev. revision 2019-07-24 18:27:37 +03:00
Alexey Milovidov
d95c6e1bc4 Attempt to solve signal safety of libunwind with solution from Fedor Korotkiy 2019-07-24 18:26:23 +03:00
Alexey Milovidov
36746d85dd Better cache for symbolizeAddress function 2019-07-24 03:47:17 +03:00
Nikita Mikhaylov
14b384f3e5
Merge branch 'master' into system_text_log 2019-07-23 15:51:04 +03:00
Alexey Milovidov
2d895c4fe6 Changed symbolizeTrace to symbolizeAddress 2019-07-23 15:46:58 +03:00
Nikita Mikhaylov
61412e7f74 changes after review + update config + resolve build fail 2019-07-23 11:22:38 +03:00
alexey-milovidov
e4ad0da6e3
Merge pull request #4247 from laplab/query-poor-mans-profiler
Poor man's profiler on query level [Work in progress]
2019-07-23 03:02:58 +03:00
Nikita Mikhaylov
8289472b98 style improvements 2019-07-22 18:09:33 +03:00
Nikita Mikhaylov
c6667ff888 wip 2019-07-22 16:54:08 +03:00
Mikhail Filimonov
f13e18d4fb atomic masker in channel 2019-07-19 10:23:51 +02:00
Mikhail Filimonov
9c2ae4513d SensitiveDataMasker 2019-07-19 10:22:42 +02:00
alexey-milovidov
6706af64d7
Merge pull request #5981 from 4ertus2/some
Count new/delete memory in MemoryTracker
2019-07-18 23:07:00 +03:00
Nikita Mikhaylov
e5360413a6 integration test added 2019-07-17 14:55:18 +03:00
chertus
3db106c1f2 disable new/delete memory tracking for unbundled build 2019-07-16 21:09:06 +03:00
Nikita Mikhaylov
ded1849559 better 2019-07-16 19:45:24 +03:00
chertus
019c156afa fix je_nalocx() call with 0 & remove std::new_handler logic 2019-07-16 19:36:10 +03:00
Nikita Mikhaylov
04de34a74f changes after review 2019-07-16 19:27:42 +03:00
chertus
4bc79bca35 fix unbandled build & add comment 2019-07-16 17:18:01 +03:00
Nikita Mikhailov
6935675917 small commit to fix build check 2019-07-16 11:36:50 +03:00
chertus
bd821d1898 exception safety and fix sanitizers' builds 2019-07-15 21:57:00 +03:00
Nikita Mikhailov
cc5f87e352 Merge branch 'master' of github.com:yandex/ClickHouse into logs_bugfix 2019-07-15 19:31:54 +03:00
Nikita Mikhailov
d192df1388 poco patch define added 2019-07-15 18:25:32 +03:00
chertus
37bee1104d Merge branch 'master' into some 2019-07-12 18:16:03 +03:00
chertus
9bd42366f0 build fixes 2019-07-12 17:41:59 +03:00
Vitaly Baranov
fd89a8b051
Merge pull request #5212 from andyyzh/custom_week_functions
Added functions for working with the Custom week number
2019-07-12 14:00:35 +03:00
chertus
9739ac13e4 move new/delete overloads to dbms/src/Common 2019-07-11 18:40:55 +03:00
Nikita Lapkov
9d540abc84 refactor 2019-07-10 20:47:39 +00:00
NIKITA MIKHAILOV
90494589e4 remove useless stderr 2019-07-10 16:32:12 +03:00
NIKITA MIKHAILOV
865606b83c bugfix client logs + some tests 2019-07-10 16:15:22 +03:00
NIKITA MIKHAILOV
21ad247df3 only for saving this changes 2019-07-10 16:05:22 +03:00
Nikita Mikhaylov
55e9e21cc5 better includes 2019-07-10 16:05:12 +03:00
Nikita Mikhaylov
f3e026edf5 static missed 2019-07-10 16:05:02 +03:00
Nikita Mikhaylov
c0a4495d17 multithreading 2019-07-10 16:04:50 +03:00
Nikita Mikhaylov
6ff9dfce34 first try 2019-07-10 16:04:01 +03:00
Alexey Milovidov
b1e7e520c0 Fixed compatibility 2019-07-09 22:30:58 +03:00
Alexey Milovidov
52bb292327 Merge branch 'master' into libcxx-as-submodule 2019-07-09 01:58:09 +03:00
Alexey Milovidov
886e8ea0d4 Merge branch 'master' into pvs-studio-fixes-4 2019-07-08 19:58:42 +03:00
Alexey Milovidov
4e1286e1e5 Addition to prev. revision 2019-07-08 05:19:50 +03:00
Alexey Milovidov
6577ecec90 Two more fixes for PVS-Studio 2019-07-08 05:06:37 +03:00
Alexey Milovidov
57d8dac95d Two more fixes for PVS-Studio 2019-07-08 05:06:15 +03:00
Alexey Milovidov
5ffcaa462a Addition to prev. revision 2019-07-08 03:08:49 +03:00
Alexey Milovidov
74b245cfd4 Fixed DateLUT initialization when /etc/localtime is a relative symlink like ../usr/share/zoneinfo/Europe/Moscow 2019-07-08 02:55:08 +03:00
Alexey Milovidov
bba2641bd0 A few fixes for PVS-Studio 2019-07-08 02:25:15 +03:00
Nikita Lapkov
aaea6cbfc9 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-05 21:37:31 +00:00
Alexey Milovidov
0225cb0089 ThreadStatus: removed bad and questionable code 2019-07-05 17:15:05 +03:00
Nikita Lapkov
b8585a5630 refactor and comments 2019-07-05 13:48:47 +00:00
Nikita Lapkov
0f579860f7 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-04 22:13:51 +00:00
Alexey Milovidov
6b9df067d8 Merge branch 'master' into libcxx-as-submodule 2019-07-03 22:34:58 +03:00
CurtizJ
80e96995ae Merge branch 'master' of https://github.com/yandex/ClickHouse into dns-cache 2019-07-03 21:27:43 +03:00
Alexey Milovidov
271f1807a3 Avoid PVS-Studio warning 2019-07-03 18:23:46 +03:00
Alexander Kuzmenkov
fe519cbea4 Pass const StringRef & to ZeroTraits::check
There is no reason to pass by value to this function, and this
is slower in debug builds, and leads to extra unexpected instrumentation
under asan.
2019-07-02 20:48:33 +03:00
Nikita Lapkov
47e1537b20 remove meaningless check (#5839) 2019-07-02 19:59:34 +03:00
alexey-milovidov
7fe87e112b
Merge pull request #5830 from yandex/filimonov-fix-macos-build
fix macos build after #4828
2019-07-02 12:52:10 +03:00
alexey-milovidov
dc59b245f1
Merge pull request #5828 from yandex/date-lut-fix-uct
Fix wrong resolution of time zone name.
2019-07-02 12:49:48 +03:00
filimonov
a08fa57711
another place with _XOPEN_SOURCE definition 2019-07-02 08:39:03 +02:00
filimonov
ea2f0dd844
fix macos build 2019-07-02 08:37:57 +02:00
Alexey Milovidov
5c721ea711 Style 2019-07-02 03:19:56 +03:00
Alexey Milovidov
97a502fcb6 Merge branch 'utc-fallback-no-tzdata' into date-lut-fix-uct 2019-07-02 03:12:50 +03:00
Alexey Milovidov
5e893c0da0 Fixed error with preference of UCT instead of UTC 2019-07-02 03:12:00 +03:00
Alexey Milovidov
ddd1a10b58 Fallback to UTC if no tzdata 2019-07-02 01:36:05 +03:00
Nikita Lapkov
5286ab97fd refactor and comments 2019-07-01 22:11:11 +00:00
Nikita Lapkov
9641d058d0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-07-01 21:11:26 +00:00
Alexey Milovidov
735eb8eeca Removed `emacs' style of quotes 2019-07-01 22:55:35 +03:00
alexey-milovidov
7474abfea6
Merge pull request #5791 from yandex/aku/store-explicit
Require explicit type in unalignedStore
2019-06-29 15:33:38 +03:00
Nikita Lapkov
2a131185b0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-06-28 18:20:23 +00:00
Nikita Lapkov
f8d2b5effd introduce Backtrace class 2019-06-28 18:06:38 +00:00
proller
c8469ab4ba
Build fixes. no submodules (#5792) 2019-06-28 21:06:09 +03:00
Alexander Kuzmenkov
0116c10e41 Require explicit type in unalignedStore
This is a follow-up to PR #5786, which fixed a segfault caused by
an unexpected deduced type for unalignedStore. To prevent future errors
of this kind, require a caller to specify the stored type explicitly.
2019-06-28 20:33:14 +03:00
Alexey Milovidov
c8d5162ec2 Compatibility with gcc-9 #5717 2019-06-27 17:28:48 +03:00
Nikita Lapkov
92309eed3e Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-06-27 14:07:44 +00:00
Nikita Lapkov
7cff36fbfc Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-06-26 11:46:04 +00:00
Ivan
cdbfa3034c
Fix compilation when we don't have readline
Otherwise we get warning about extra semi-colon
2019-06-24 18:02:25 +03:00
Andy Yang
4b6efaa4b9 Merge branch 'master' into custom_week_functions
update last code
2019-06-24 09:53:38 +08:00
Andy Yang
ab8d2058c6 Fix code styles 2019-06-19 09:25:17 +08:00
proller
1cb0ba5854 Cmake: better USE_STATIC_LIBRARIES and SPLIT_SHARED_LIBRARIES handling 2019-06-18 20:10:25 +03:00
Andy Yang
e2216555dd Fix build error which g++-8 2019-06-18 19:29:28 +08:00
Andy Yang
5db11932d7 Fix code styles 2019-06-18 18:08:12 +08:00
Andy Yang
6085fce8d7 some review fixes and add new function toStartOfWeek 2019-06-18 17:48:07 +08:00
proller
2a6c7cda0b CLICKHOUSE-4179 Fix function arrayEnumerateUniqRanked (#5622)
* wip

* fix

* clean
2019-06-15 22:14:17 +03:00
proller
fe60f96612 Fix comments from #5540 2019-06-14 18:49:38 +03:00
Alexey Milovidov
6971eef584 Cleanups for #5540 2019-06-14 17:05:59 +03:00
proller
09f3d68f6e Use logging in clickhouse-local. Use config options in command line in clickhouse-client (#5540)
* Try fix macos server run

* Doc macos build
 # Please enter the commit message for your changes. Lines starting

* CLICKHOUSE-3957 start wip

* tests wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* fix

* fix

* Making logger for clickhouse-local

* fixes

* wip

* wip

* wip

* wip

* clean

*      cf

* wip

* fix

* Update CMakeLists.txt

* Update argsToConfig.h

* Update argsToConfig.cpp

* Update ExtendedLogChannel.h

* Update OwnPatternFormatter.cpp
2019-06-14 17:00:37 +03:00
Andy Yang
7c15a32ef3 Merge branch 'master' into custom_week_functions
Update the latest code
2019-06-10 09:40:43 +08:00