aboutsummaryrefslogtreecommitdiff
path: root/docker/heka
AgeCommit message (Collapse)AuthorFilesLines
2017-02-24Remove heka imageJeffrey Zhang19-1278/+0
Heka is removed and replaced by fluentd. Change-Id: I4ed0f61b02bea5dcb02b61a9eb99e3ff3f460682
2017-02-05Remove include_header and include_footer in all DockerfilesJeffrey Zhang1-1/+0
include_header and include_footer parameter is already removed, remove them in all Dockerfiles. Add missing footer block. Change-Id: I90da03eb9f95a3827361d5f5ede65fde7d6be2b3
2017-01-17use static uid/gid in imagesSam Yaple1-4/+4
This centralizes all user and group creation into a single source. This will fix any current and furture uid/gid mismatches (such as with nova-libvirt). In the process, we also unify users between the distros in a standard way. The users in the following containers change from thier defaults: Ubuntu: _chrony user is now chrony Ubuntu: memcache user is now memcached All: qemu user is used for ownership and socket permissions All uid and gid numbers are customizable via kolla-build.conf Co-Authored-By: Kris Lindgren <klindgren@godaddy.com> Change-Id: I120f26ab0683dc87d69727c3df8d4707e52a4543 Partially-Implements: blueprint static-uid-gid
2017-01-07Fix zaqar containerEduardo Gonzalez1-0/+72
This PS is part of a rework on zaqar container. In it's current state is not working in kolla. Will be adding/fixing issues under this PS. - Remove bootstrap zaqar: At this point zaqar-manage command does not exist. Boostraping is not needed while starting zaqar container. - Add pymongo package in source install. - Create /var/log/kolla folder. - Change zaqar homedir to /var/lib/zaqar and unify creation. - Zaqar's source default have config files as *.sample. Policy.json need to be present if keystone auth is going to be used. - Zaqar uses wsgi to the API, heka decoder need to be added Change-Id: I9c6716b64345d9e846902ffbfbf033135e3eabd9 Closes-Bug: #1647831
2016-12-06Merge "add aodh os_aodh_apache_log.lua in heka"Jenkins1-0/+71
2016-12-05Merge "add os_gnocchi_apache_log.lua in heka"Jenkins1-0/+71
2016-12-02add aodh os_aodh_apache_log.lua in hekazhubingbing1-0/+71
Change-Id: I4828def47e42eb999c4e329f5abf5b78d03064e8 Closes-Bug: #1632008
2016-12-02add os_gnocchi_apache_log.lua in hekazhubingbing1-0/+71
Change-Id: I4cb986c4b00f88bed8815bcd025d1abecd32b91e Closes-Bug: #1632004
2016-11-30add os_panko_apache_log.lua in hekazhubingbing1-0/+72
support panko in heka Change-Id: If6b44af2473f93e1b00aff6c4c626c421df1f045 Closes-Bug: #1645973
2016-11-06Adding logrotate configuration for ceilometerprameswar1-0/+72
Closes-bug: #1635316 Change-Id: I3195518f1ee52249bc6259d3cab0f479f5522df1
2016-11-04Merge "add grafana log in heka"Jenkins1-0/+72
2016-11-03Remove Fedora supportChristian Berendt1-1/+1
Closes-bug: #1616387 Change-Id: Id97f88b9baa3d48d33ce120962450a374282d044
2016-10-10add grafana log in hekazhubingbing1-0/+72
Change-Id: I38b57cc43411b703dbb0639a600aaef58e01bc38 Closes-Bug: #1631818
2016-09-13Add header blocks to all DockerfilesPaul Bourke1-0/+2
Change needed to add header blocks to all Dockerfiles, similar to the base. Use case is to easily run something before packages are installed, e.g. to COPY a local rpm in that can be added to the package list. Change-Id: I1bbfdf0b762da0a392aa8bf47781315b45377bee Closes-Bug: 1618969
2016-08-19Handle empty package list for install_packagesShaun Smekel1-1/+1
Currently if the install_packages macro is run with an empty package list, it will add a yum or apt-get command with no packages listed. This bug fix aims to omit this line when no packages have been given, or, the operator wants to use the "_override" / "_remove" functionality to disable all packages being installed in a Dockerfile. Co-Authored-By: Paul Bourke <paul.bourke@oracle.com> Change-Id: Ifaaaebfccc3adb0f2f68a35ac08e59378bc87fdb Closes-bug: 1612446
2016-08-17Customizations for hekaJosh Lothian1-10/+13
This patchset contains customization of Dockerfile for heka container. Change-Id: I86a76fda182c745ae33c75a83113f471ea220a0c Partially-implements: blueprint third-party-plugin-support
2016-08-06Fix inconsistencies in git urlRobin Naundorf1-1/+1
Github is just a mirror of the OpenStack git-repo. Changed from Github to OpenStack git url wherever possible. Change-Id: I7941ef86967de4efe7f23ff9fb11ec86c793901e
2016-07-05Fix the overwrite sudoers file issueJeffrey Zhang1-2/+2
Change-Id: I4b109f7fdc3b8e49defed26979b04ca158842e98 Closes-Bug: #1598423
2016-06-04Make heka container build with debianBenedikt Trefzer1-1/+1
Change-Id: I911a684e1269076f9466fe0b6511c0b72dd80833 Partially-implements: blueprint build-debian
2016-04-12Update Heka dockerfile for formattingSwapnil Kulkarni (coolsvap)1-1/+2
Change-Id: Ib5cab0200f6e8fbea3de89624067771e92024b2f Partial-Bug:#1569417
2016-04-12Create and chown /etc/heka directoryMichal Rostecki1-2/+3
This directory is needed for kolla-mesos to save config files there. Change-Id: Ia9810061d370bc600dfffeb33a4d4402c423e3fc Closes-Bug: 1567437
2016-03-22Changes horizon log location to kolla_logs volumeSerguei Bezverkhi1-0/+72
Changes location of Horizon log, they will be stored on common log volume kolla_logs. Change-Id: Ie9d56999a83efd05ab7c3dcb00b4dc42c9bce8f8 Closes-Bug: 1560250
2016-03-05Make Heka send logs to ElasticsearchÉric Lemoine2-2/+2
This patch includes changes relative to integrating Heka with Elasticsearch and Kibana. The main change is the addition of an Heka ElasticSearchOutput plugin to make Heka send the logs it collects to Elasticsearch. Since Logstash is not used the enable_elk deploy variable is renamed to enable_central_logging. If enable_central_logging is false then Elasticsearch and Kibana are not started, and Heka won't attempt to send logs to Elasticsearch. By default enable_central_logging is set to false. If enable_central_logging is set to true after deployment then the Heka container needs to be recreated (for Heka to get the new configuration). The Kibana configuration used property names that are deprecated in Kibana 4.2. This is changed to use non-deprecated property names. Previously logs read from files and from Syslog had a different Type in Heka. This is changed to always use "log" for the Type. In this way just one index instead of two is used in Elasticsearch, making things easier to the user on the visualization side. The HAProxy configuration is changed to add entries for Kibana. Kibana server is now accessible via the internal VIP, and also via the external VIP if there's one configured. The HAProxy configuration is changed to add an entry for Elasticsearch. So Elasticsearch is now accessible via the internal VIP. Heka uses that channel for communicating with Elasticsearch. Note that currently the Heka logs include "Plugin elasticsearch_output" errors when Heka starts. This occurs when Heka starts processing logs while Elasticsearch is not yet started. These are transient errors that go away when Elasticsearch is ready. And with buffering enabled on the ElasticSearchOuput plugin logs will be buffered and then retransmitted when Elasticsearch is ready. Change-Id: I6ff7a4f0ad04c4c666e174693a35ff49914280bb Implements: blueprint central-logging-service
2016-02-26Fix parsing of RabbitMQ logsÉric Lemoine1-0/+2
Currently Heka fails to parse the RabbitMQ logs. There are two problems: 1. The rabbit-sasl.log file is ignored but the file_match expression does not match. 2. The delimiter used in the RegexSplitter makes Heka stop on the very first log entry. '\n\n(=[^=]+====' (with two \n's) is a better delimiter. deliver_incomplete_final is used to get the final log entry. TrivialFix Change-Id: I94720340d5b2d6fd5d7641b9ff58733f6cd882ee
2016-02-22Merge "Fix Swift logging"Jenkins1-0/+49
2016-02-22Merge "Change Heka sudoers file mode bits"Jenkins1-0/+1
2016-02-22Fix Swift loggingÉric Lemoine1-0/+49
Swift uses Syslog, but it uses a custom log format. So this commit adds a specific Heka decoder for Swift. It also increases the log level from "warning" to "info" to make Swift more verbose. Note that "info" is the default log level in Swift. And it disables the Heka configuration for Swift when "enable_swift" is set to "no". This prevents Heka from creating 15 empty Swift log files in the logs volume. Partially implements: blueprint heka Change-Id: If7a7d0707e71be2957178e2d45b5de51b788232e
2016-02-22Run yum clean all in Heka DockerfileÉric Lemoine1-0/+1
This follows up on a review comment from Steven Dake. See https://review.openstack.org/#/c/275840/14/docker/heka/Dockerfile.j2@21 Closes-Bug: #1547535 Partially implements: blueprint heka Change-Id: I4f5094145d8f5bbc04fe23e64c6a39719775bae4
2016-02-22Create "heka" group and add "heka" user to itÉric Lemoine1-1/+1
TrivialFix Partially implements: blueprint heka Change-Id: I55053251596394685fd632748b42ba23ecfbeccb
2016-02-22Change Heka sudoers file mode bitsÉric Lemoine1-0/+1
This follows up on a review comment from Steven Dake. See https://review.openstack.org/#/c/275840/14/docker/heka/Dockerfile.j2@21 Closes-Bug: #1547536 Partially implements: blueprint heka Change-Id: Ie85b64be139257f7da7cecd82a7971d7550d27d4
2016-02-19Add Heka log decoder for Keystone/ApacheÉric Lemoine1-0/+72
Partially implements: blueprint heka Change-Id: I562dddcfa75f3a814874f7735d735416d9aa7803
2016-02-19Add Heka log decoder for MariaDBÉric Lemoine1-0/+50
In the future the Heka Lua sandboxes will be moved out of Kolla, and installed in the Heka container using a deb or rpm package. Partially implements: blueprint heka Change-Id: Iad1e5177d239410a88546fc4ed8c23b9e46beef3
2016-02-19Add Heka log decoder for OpenStackÉric Lemoine1-0/+140
In the future the Heka Lua sandboxes will be moved out of Kolla, and installed in the Heka container using a deb or rpm package. Partially implements: blueprint heka Change-Id: I70fd4af920aa2dfb1c8ef9ce8bf6e0c28507ec3e
2016-02-19Add Heka log decoder for RabbitMQÉric Lemoine1-0/+70
In the future the Heka Lua sandboxes will be moved out of Kolla, and installed in the Heka container using a deb or rpm package. Partially implements: blueprint heka Change-Id: I1aa27048d22f1a5ed385180696d320af9a961389
2016-02-19Add Heka log decoder infrastructureÉric Lemoine5-0/+318
In the future the Heka Lua sandboxes will be moved out of Kolla, and installed in the Heka container using a deb or rpm package. Partially implements: blueprint heka Change-Id: I34cc80f62ddbca8ee330c971f58fee8686e245e6
2016-02-19Add a Dockerfile for HekaÉric Lemoine3-0/+67
Partially implements: blueprint heka Change-Id: Iafe0dba1333f1f84bc5956890c3b7a0c2a45cef3