Skip to content

Instantly share code, notes, and snippets.

@fire
Forked from sacreman/dalmatiner.md
Created August 28, 2016 13:50
Show Gist options
  • Save fire/09161277fd9ae54ad34ccc75e5667467 to your computer and use it in GitHub Desktop.
Save fire/09161277fd9ae54ad34ccc75e5667467 to your computer and use it in GitHub Desktop.

Overview

These instructions outline how to install DalmatinerDB on a single node. Scaling out will be covered in a future document. It also covers configuring Telegraf to send in monitoring data and Grafana to build dashboards.

Here's how everything connects together:

dalmatiner architecture

Create a VM

Ubuntu 16.04 x86_64 with 16GB memory

Create a ZFS filesystem

apt-get update && apt-get install zfs

cd / && touch vdev1 && truncate -s 900G vdev1 # change 900G to appropriate allocation

zpool create data /vdev1

zfs create data/ddb -o compression=lz4 -o atime=off -o logbias=throughput

chown dalmatiner. /data/ddb

Install DalmatinerDB

Storage

wget https://github.com/davecromberge/dalmatinerdb/releases/download/v0.2.0/dalmatinerdb_0.2.0_amd64.deb

dpkg -i dalmatinerdb_0.2.0_amd64.deb

vi /etc/ddb/ddb.conf # change platform_data_dir = /data/ddb

service ddb start # need to add /etc/systemd/system/ddb.service to package

Query Engine

wget https://github.com/davecromberge/dalmatiner-frontend/releases/download/0.2.0/dalmatiner-frontend_0.2.0_amd64.deb

dpkg -i dalmatiner-frontend_0.2.0_amd64.deb

service dfe start

Setup Postgres

curl -s http://apt.postgresql.org/pub/repos/apt/ACCC4CF8.asc | apt-key add -

echo 'deb http://apt.postgresql.org/pub/repos/apt precise-pgdg main 9.5' > /etc/apt/sources.list.d/postgresql.list

apt-get update && apt-get install postgresql-9.5

service postgresql start

su - postgres -c "psql -f /var/lib/dfe/schema.sql"

service dfe restart

Install Grafana

curl https://packagecloud.io/gpg.key | sudo apt-key add -

echo 'deb https://packagecloud.io/grafana/stable/debian/ wheezy main' > /etc/apt/sources.list.d/grafana.list

apt-get update && apt-get install grafana

service grafana-server start

git clone https://github.com/dalmatinerdb/dalmatinerdb-datasource.git /var/lib/grafana/plugins/dalmatinerdb

service grafana-server restart

Install DDB Proxy

wget https://github.com/davecromberge/ddb_proxy/releases/download/0.1.0/ddb-proxy_0.1.0_amd64.deb

dpkg -i ddb-proxy_0.1.0_amd64.deb

service ddb_proxy start

Setup Telegraph

wget https://dl.influxdata.com/telegraf/releases/telegraf_0.13.2_amd64.deb

dpkg -i telegraf_0.13.2_amd64.deb

vi /etc/telegraf/telegraf.conf # comment influxdb output and uncomment opentsdb output on localhost port 4242 (the defaults)

service telegraf restart

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment