Commit Graph

178 Commits

Author SHA1 Message Date
alesapin
e026759443 Fix fds close logic 2019-01-22 17:37:28 +03:00
Alexey Milovidov
f1bb9fc05a Removed useless code 2019-01-20 00:05:20 +03:00
Nikita Lapkov
4c55802552 refactor
- add exceptions on timer errors
- move from signal to sigaction
- extract backtrace collection logic
2019-01-18 13:10:43 +00:00
Alexey Milovidov
f6b9b06307 Attempt to implemnt global thread pool #4018 2019-01-14 22:22:09 +03:00
proller
f1791e94e2
Do not write preprocessed configs to /etc/ (#2443) 2018-11-27 19:11:46 +03:00
alexey-milovidov
2c2d75cceb
Don't allow exceptions without code (#3645)
* Don't allow exceptions without code #3633

* Don't allow exceptions without code #3633
2018-11-23 00:19:58 +03:00
Alexey Milovidov
ab5d76fc42 Fixed error introduced in #3553 and prevent it happening 2018-11-21 23:56:37 +03:00
alexey-milovidov
b1db9ec23c
Merge pull request #3436 from amosbird/master
Flexible fields assignment
2018-11-01 20:22:28 +03:00
proller
f86d1a7034 CONTRIB-254 Arcadia fixes (#3475)
* Macos: set ENABLE_EMBEDDED_COMPILER=0 by default (because contrib/llvm temporary broken under macos)

* \n

* arcadia fix

* fix arcadia link

* wip

* wip

* wip

* fix

* wip

* wip

* fix

* try use users from server dir

* Revert "try use users from server dir"

This reverts commit 79b2c6fd9c.

* Fix logging

* fix

* Update ZooKeeperImpl.h
2018-11-01 20:07:20 +03:00
Amos Bird
3cf2177268 Flexible fields assignment
Field f;

before:

f = Int64(-42);

after:

f = -42;
2018-10-24 08:47:33 +08:00
Alexey Milovidov
5c386ea3cd Always write query_id field in log #3203 2018-09-24 21:44:40 +03:00
proller
d2ad686556
Try fix macos server run (#3102) 2018-09-11 20:48:25 +03:00
proller
4529f33457 Fix clickhouse-test-server
rename /var/log/clickhouse-server/stderr to stderr.log and stdout to stdout.log
2018-08-29 21:48:14 +03:00
Alexey Milovidov
17b89d7dc7 Simplified terminate handler [#CLICKHOUSE-2] 2018-08-29 21:35:46 +03:00
Alexey Milovidov
bcbcbcdbb1 Merge branch 'master' of github.com:yandex/ClickHouse 2018-08-21 02:22:30 +03:00
Alexey Milovidov
8ca2eed716 Miscellaneous [#CLICKHOUSE-2]. 2018-08-21 02:16:50 +03:00
Alexey Milovidov
328c1387c0 Removed Poco::NumberFormatter [#CLICKHOUSE-2] 2018-08-20 22:35:04 +03:00
Alexey Milovidov
acb99b49df Merge branch 'master' into CLICKHOUSE-2910 2018-08-14 23:29:42 +03:00
alesapin
53b23e0113 CLICKHOUSE-3878: Add inherited fd's closing function 2018-08-12 15:23:22 +03:00
alesapin
dd01eb6b40 CLICKHOUSE-3878: Add odbc-bridge first version 2018-08-07 20:57:44 +03:00
proller
c7848d2062 CLICKHOUSE-3771: Fixes 2018-07-17 21:22:32 +03:00
Alexey Milovidov
158742831e Little better #2482 2018-07-04 16:29:31 +03:00
Alexey Milovidov
5d00a23f47 Leave thread number in log in a consistent place #2482 2018-06-28 23:04:13 +03:00
Vitaliy Lyudvichenko
358e4ae9bf Fixed failures in utils, more precise test. [#CLICKHOUSE-2910] 2018-06-20 18:41:15 +03:00
Vitaliy Lyudvichenko
392f6e0c6c Print query_id in logs. Add own logging interface. [#CLICKHOUSE-2910] 2018-06-18 16:41:13 +03:00
Vitaliy Lyudvichenko
4cd230f85c Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-14 16:04:00 +03:00
Vitaliy Lyudvichenko
ac54e52fb3 Add server logs passing to client. [#CLICKHOUSE-2910] 2018-06-07 20:58:50 +03:00
alexey-milovidov
726061b693 Update BaseDaemon.cpp 2018-06-01 20:45:03 +03:00
Alexandr Krasheninnikov
8d273e776b Syslog logging support 2018-06-01 20:45:03 +03:00
Vitaliy Lyudvichenko
9b681eb974 Suppress compiler warnings. [#CLICKHOUSE-2] 2018-05-15 21:10:50 +03:00
Vitaliy Lyudvichenko
7d1078d992 Add config key to force stderr redirecting. [#CLICKHOUSE-2] 2018-05-15 20:05:13 +03:00
Vitaliy Lyudvichenko
31c4a51ae4 Reverted bad changes. [#CLICKHOUSE-2] 2018-05-15 19:22:00 +03:00
Vitaliy Lyudvichenko
fb7e6350db Fixed disabled stderr output. Better configs for clickhouse-copier. [#CLICKHOUSE-2] 2018-05-14 17:14:58 +03:00
proller
89b67dd25a Simpler disable logging to file in conf.d (<log/> <errorlog/>) 2018-04-19 21:25:04 +03:00
proller
bbb12e89f0 Better listen_try, pbuilder fix (#2068)
* rename libboost/boost_1_65_0 -> contrib/boost ; make submodule ; update boost to 1.66.0

* Update contrib/boost

* Update contrib/boost

* Add comments

* Fix

* Pbuilder fix

* Better listen_try

* Much better listen_try

* Revert "remove ipv6 listen_host from docker_related_config to allow running in ipv4-only dockers"

This reverts commit 3cfa4c3e65.

* Fix freebsd and macos build
2018-03-18 12:02:29 +03:00
Alexey Milovidov
2bc42d53f4 More information on signals [#CLICKHOUSE-2] 2018-03-16 08:18:13 +03:00
Alexey Milovidov
8b59db58c3 Fixed uneven code #2032 2018-03-14 02:44:23 +03:00
Alexey Milovidov
28b46655db Added support for MSan [#CLICKHOUSE-2] 2018-03-03 23:37:12 +03:00
Alexey Milovidov
7077405e8a Added support for MSan [#CLICKHOUSE-2] 2018-03-03 22:49:21 +03:00
proller
d6a1f8470f CLICKHOUSE-3553 Rebuild loggers on every config change (#1973)
* Macos test fix

* Fix freebsd build

* CLICKHOUSE-3553 Rebuild loggers on every config change

* rename clickhouse_common_configprocessor -> clickhouse_common_config; move Server/ConfigReloader.cpp -> Common/Config/

* CLICKHOUSE-3553 Set new level to all loggers on reload

* Dont use hash

* Update BaseDaemon.h
2018-02-28 23:34:25 +03:00
Alexey Milovidov
c86fd31097 Addition to prev. revision [#CLICKHOUSE-2] 2018-02-25 05:23:04 +03:00
Alexey Milovidov
dd52ea8343 Fixed typos [#CLICKHOUSE-3] 2018-02-22 23:44:10 +03:00
proller
19f71fbd45 Fix logging to current dir 2018-02-14 23:43:08 +03:00
proller
82d74f5ab3 Allow redefine server config via command line: clickhouse-server -- --logger.level=information (#1811)
* Aloow redefine server config via command line: clickhouse-server -- --logger.level=information

* style

* fix

* BaseDaemon: Simpler createDirectory

* Allow --key value

* Update BaseDaemon.cpp

* Update BaseDaemon.cpp
2018-02-08 22:12:37 +03:00
proller
91ca67d987 Fix logger, return systemd service (#1798)
* Fix test 281 under asan

* Cmake fixes

* Revert "Disable usage of systemd (assumed that temporarily) [#CLICKHOUSE-2]"

This reverts commit f0aa21bca6.

* Fixing init scripts and logging

* Fix logger

* Fxi

* fix

* fix

* fix

* Update clickhouse-server-base.postinst

* Update clickhouse-server.cron.d

* Update clickhouse-server-base.postinst

* Update clickhouse-server-base.postinst

* fix

* fix

* space

* better message
2018-01-19 21:54:40 +03:00
Alexey Milovidov
0e818311e0 Clarifications [#CLICKHOUSE-2] 2018-01-17 21:10:38 +03:00
Alexey Milovidov
0101cd24d6 Translated comments [#CLICKHOUSE-2] 2018-01-17 21:06:39 +03:00
Alexey Milovidov
9ad18c5019 Whitespaces [#CLICKHOUSE-2] 2018-01-17 19:39:56 +03:00
proller
d97b2edc7c Make separate libs Common/ZooKeeper and Common/ConfigProcessor (#1749)
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed:    dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h

* Fix space

* Fix data in system.build_options

* merge

* merge
2018-01-15 22:07:47 +03:00
Alexey Milovidov
f36af6187b Added comment [#CLICKHOUSE-2]. 2018-01-13 04:40:43 +03:00
proller
3c54be8d5b Add hostname_in_path=true option to garaphite config (#1701)
* Add hostname_in_path=true option to garaphite config

* fix style

* Update config.xml
2017-12-25 23:36:24 +03:00
Alexey Vasiliev
6cb97b9221 ConfigProcessor: do not create config-preprocessed before setting umask [#MOBMET-7044] 2017-11-25 02:00:10 +03:00
proller
411202d5ad Zlib: as submodule, fix compile options; config: add logger options: logger.flush logger.rotateOnOpen 2017-11-21 23:10:37 +03:00
Alexey Milovidov
01e8adbfff Removed "experimental" namespace [#CLICKHOUSE-2]. 2017-11-20 07:15:43 +03:00
proller
ef1b559845 Check pid file contents inside clickhouse server (#1498)
* Check pid file contents inside clickhouse (allow run with exists pid file but not exists process)

* fix

* fix

* eol

* wip
2017-11-16 22:09:08 +03:00
proller
443088ce31 Use c++11 thread_local instaed of gcc's __thread 2017-10-19 22:36:37 +03:00
proller
64194c9b03 Updating poco and making submodule (#1263)
* Updating poco part 1: use submodule

* switch to tmp submodule

* update submodule

* wip

* wip

* wip

* wip

* wip

* fix

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* test

* wip

* wip

* wip

* wip

* wip

* wip

* Remove werror

* wip

* wip

* wip

* wip

* wip

* Block pipe signal

* Update poco

* Update and fix poco

* Better sigpipe handler

* Better block sigpipe

* Update BaseDaemon.cpp
2017-10-13 21:58:19 +03:00
alexey-milovidov
3382a730b8 Merge pull request #1315 from yandex/libunwind-fix
Libunwind fix
2017-10-03 17:06:37 +03:00
proller
4e4355a210 Prevent infinite recursion in faultSignalHandler (#CLICKHOUSE-3304) (#1288)
* Prevent infinite recursion in faultSignalHandler (#CLICKHOUSE-3304)

21 0x00000000012a0cbd in faultSignalHandler (sig=<optimized out>, info=0x7ffcacfd5730, context=0x7ffcacfd5600)
   at /home/robot-metrika-test/jenkins/workspace/clickhouse-packages-build@2/sources/libs/libdaemon/src/BaseDaemon.cpp:166
22 <signal handler called>
23 0x00007fc770f90c37 in raise () from /lib/x86_64-linux-gnu/libc.so.6
24 0x00007fc770f94028 in abort () from /lib/x86_64-linux-gnu/libc.so.6
25 0x00000000012a0d5f in terminate_handler () at /home/robot-metrika-test/jenkins/workspace/clickhouse-packages-build@2/sources/libs/libdaemon/src/BaseDaemon.cpp:404
26 0x00000000037c8836 in __cxxabiv1::__terminate(void (*)()) ()
27 0x000000000382d379 in __cxa_call_terminate ()
28 0x00000000037d475d in __gxx_personality_v0 ()
29 0x00000000038331a3 in _Unwind_RaiseException_Phase2 ()
30 0x00000000038339c7 in _Unwind_Resume ()
31 0x00000000012a0cbd in faultSignalHandler (sig=<optimized out>, info=0x7ffcacfd6ef0, context=0x7ffcacfd6dc0)
   at /home/robot-metrika-test/jenkins/workspace/clickhouse-packages-build@2/sources/libs/libdaemon/src/BaseDaemon.cpp:166
32 <signal handler called>
33 0x00007fc770f90c37 in raise () from /lib/x86_64-linux-gnu/libc.so.6
34 0x00007fc770f94028 in abort () from /lib/x86_64-linux-gnu/libc.so.6
35 0x00000000012a0d5f in terminate_handler () at /home/robot-metrika-test/jenkins/workspace/clickhouse-packages-build@2/sources/libs/libdaemon/src/BaseDaemon.cpp:404
36 0x00000000037c8836 in __cxxabiv1::__terminate(void (*)()) ()
37 0x000000000382d379 in __cxa_call_terminate ()
38 0x00000000037d475d in __gxx_personality_v0 ()
39 0x00000000038331a3 in _Unwind_RaiseException_Phase2 ()
40 0x00000000038339c7 in _Unwind_Resume ()
41 0x00000000012a0cbd in faultSignalHandler (sig=<optimized out>, info=0x7ffcacfd86b0, context=0x7ffcacfd8580)
   at /home/robot-metrika-test/jenkins/workspace/clickhouse-packages-build@2/sources/libs/libdaemon/src/BaseDaemon.cpp:166

* Requested changes
2017-09-30 14:04:56 +03:00
Vladimir Chebotarev
07c964ef3b contrib: Fixed unwind build under GCC 7. [#METR-21516]
See https://gcc.gnu.org/bugzilla/show_bug.cgi?id=81712 .
2017-09-28 23:28:37 +03:00
Alexey Milovidov
8b313ab99e Fixed warnings found by cppcheck [#CLICKHOUSE-3300]. 2017-09-08 00:04:48 +03:00
Alexey Milovidov
76957f77c4 Removed strange empty space [#CLICKHOUSE-2]. 2017-09-06 23:02:11 +03:00
Vladimir Chebotarev
87cc80c30e libdaemon: Moved default graphite config name to constant. [#CHEBOTAREV-14] 2017-08-24 16:37:27 +03:00
Alexey Milovidov
4687a2730d Allow to override umask in config [#CLICKHOUSE-2]. 2017-08-18 04:00:13 +03:00
Alexey Zatelepin
874b180adf don't skip top of the backtrace [#CLICKHOUSE-3094] 2017-07-20 18:23:26 +03:00
proller
2d359fee54 Make libunwind optional. Allow use custom libcctz (#920)
* Make libunwind optional. Allow use custom libcctz

* fix

* Fix

* fix

* Update BaseDaemon.cpp

* Update CMakeLists.txt
2017-06-23 17:41:07 +03:00
Alexey Milovidov
d823135d24 Using libunwind for stack trace from signal handler [#CLICKHOUSE-3094]. 2017-06-23 08:39:27 +03:00
aprudaev
1cd217ba56 Fix reload configuration memory leak (#892)
* On reload remove previous configuration from LayeredConfiguration.

* fix build
2017-06-19 16:31:55 +03:00
proller
bcb230ebc6 Fix incudes, move code from daemon/OwnPatternFormatter.h 2017-04-27 08:40:27 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
proller
670e98fa92 allow several <graphite> targets (#603)
* allow several <graphite> targets

* fix

* fix

* Adjustable parts

* changelog version

* fix

* changelog

* Style fixes

* attachSystemTables

* config describe

* fixes

* fixes
2017-03-21 23:08:09 +04:00
Alexey Zatelepin
faadab3034 Allow including config elements from ZooKeeper [#CLICKHOUSE-2794] 2017-03-19 21:58:12 +04:00
egatov
2c12df495c Metr 24491 (#606)
* fixed external biuld [#METR-24491].

* fix [#METR-24491].

* Update CMakeLists.txt
2017-03-16 22:27:23 +03:00
proller
930ac5b2ce move ClickHouseRevision to dbms 2017-03-16 13:51:41 +04:00
Alexey Milovidov
b35bc57fdc Addition to prev. revision [#CLICKHOUSE-2]. 2017-03-13 22:35:46 +03:00
Alexey Milovidov
7bee9f650e Removed old logic, when paths in graphite could use something other than FQDN [#MTRSADMIN-2700]. 2017-02-16 22:46:22 +03:00
Alexey Milovidov
b5d5fcc17d Merge branch 'master' of github.com:yandex/ClickHouse 2017-02-14 15:12:44 +03:00
Alexey Milovidov
b4a47af61d Style [#CLICKHOUSE-2]. 2017-02-14 15:12:23 +03:00
proller
ed659bb64e Create core dir: dont crash if have no permissions (#486)
* Create core dir: dont crash if have no permissions

* debian postinst: Fix changing owner of old /opt/clickhouse

* space

* fix

* fix
2017-02-14 16:11:46 +04:00
alexey-milovidov
cee5ab01fb Merge branch 'master' into merge_with_metrika 2017-02-11 00:27:15 +04:00
Pavel Kartavyy
5107cd94b3 support absence of BaseDaemon in OwnPatternFormatter 2017-02-07 19:37:56 +03:00
Pavel Kartavyy
6d48eacbff update usage of OwnPatternFormatter 2017-02-07 15:24:28 +03:00
Alexey Zatelepin
7522cecd67 differentiate setrlimit error messages 2017-02-07 09:28:53 +04:00
Pavel Kartavyy
b61bd0b96b Merge commit '84e4fb00bd0373058bfc091d2d19a8034df7cc93' into update-clickhouse
Conflicts:
	metrica/src/ClickHouse/libs/libdaemon/src/BaseDaemon.cpp
2017-02-06 17:57:47 +03:00
proller
9c3133deac wip 2017-01-25 16:17:13 +03:00
Alexey Milovidov
6ec9380510 Allow to set server timezone from configuration file [#CLICKHOUSE-2765]. 2017-01-22 15:53:24 +03:00
proller
1649b003a0 Better user-group creating in postinst, BaseDaemon::getDefaultCorePath [#METR-23811] 2017-01-09 16:42:29 +03:00
proller
4bc003c4c1 Porting to freebsd: initial, compile ok, most tests ok. 2016-12-24 01:03:10 +00:00
Alexey Milovidov
fc43827a6c Preparation [#METR-2944]. 2016-12-12 06:33:34 +03:00
Alexey Milovidov
6fbf550387 Write microseconds to log [#METR-22327]. 2016-11-18 02:29:22 +03:00
Vladimir Smirnov
d36f52502e Make it compilable on OS X
It's still hackish and dirty, but server and client compies.

Server starts, but throwes meaningless exception on any query.

Client seems to be working fine.

Linux compilation might (but shouldn't) be broken (not tested).
2016-11-01 17:59:21 +01:00
Pavel Kartavyy
b6118b1581 Test::initLogger(): use custom formatter in logging. supports logname, timestamp etc. [#METR-22785] 2016-10-04 12:58:38 +03:00
Alexander Prudaev
a1c8008f2d fix segfault in BaseDamon destructor [#METR-22887]. 2016-09-26 15:34:54 +03:00
Pavel Kartavyy
ba9cf229cd dbms: remove unused headers 2016-08-22 18:07:02 +03:00
Pavel Kartavyy
2032acd557 Merge commit 'e960efd5e63e4de51151724db92e6c2548aa88d9'
Conflicts:
	metrica/src/ClickHouse/libs/libdaemon/include/daemon/GraphiteWriter.h
	metrica/src/ClickHouse/libs/libdaemon/src/GraphiteWriter.cpp
2016-08-22 17:22:27 +03:00
Pavel Kartavyy
6e7bb0cd65 Merge branch 'master' into METR-19530
Conflicts:
	metrica/src/CMakeLists.txt
	metrica/src/ClickHouse/libs/libdaemon/include/daemon/GraphiteWriter.h
	metrica/src/ClickHouse/libs/libdaemon/src/GraphiteWriter.cpp
	metrica/src/libs/CMakeLists.txt
	metrica/src/libs/liblogbroker-client/src/LogBroker.cpp
	metrica/src/libs/liblogbroker-log-import/include/logbroker-log-import/LogBrokerLogImportTask-inl.h
	metrica/src/libs/libstatdaemons/include/statdaemons/write_destinations/ClickHouseCluster.h
	metrica/src/programs/cleanerd/src/config.xml
	metrica/src/programs/deduplicatord/src/Task.cpp
	metrica/src/programs/visit-log-processor/src/VisitLogHandler.h
	metrica/src/tools/ssqls/templates/header.tpl
2016-08-19 17:15:58 +03:00
Pavel Kartavyy
f9af920679 Merge commit '80e8c38c280f60d11ede1833908e3f68344e1d08' 2016-08-18 12:36:38 +03:00
Alexey Milovidov
6d6c22f92e Allow to start under thread sanitizer [#METR-2944]. 2016-07-30 07:44:04 +03:00
Alexey Vasiliev
1bef561c32 code reviewed [#MOBMET-3538] 2016-07-29 15:50:19 +03:00