[ProgClub programming] Centralised logging

Jedd Rashbrooke jedd.rashbrooke at gmail.com
Wed Jun 12 00:22:50 AEST 2019


On Wed, 12 Jun 2019 at 00:07, John Elliot V | ProgClub <jj5 at progclub.org>
wrote:

> Hrumph. I'm stuck creating the VM disk, even before I get to the LVM
> options in the installer. For my VM (let's start with the Graylog one)
> do I add two virtual disks, or one virtual disk? How big should those
> things be initially?


 You're doing that thing again, where there's no context whatsoever around
what you're doing, and only vague error / problem descriptions.

 Are you on a proper operating system, or some IaaS offering?

 What 'installer' are you referring to?

 What's a 'virtual disk' in this instance - something you're paying for up
front?   Something you can easily augment with additional 'virtual disks'
as you go along?

 In any case, in a vanilla instance I'd suggest 50GB for / as the default
basic disk, and then add a 500GB disk that you set up as a physical volume
(PV) and then allocate a small amount (100GB?) to ... pick a location.
 Which box are you building now?

 My log server:

py-log-01:~# lsblk
NAME                        MAJ:MIN RM   SIZE RO TYPE  MOUNTPOINT
fd0                           2:0    1     4K  0 disk
loop0                         7:0    0 465.8G  0 loop
└─md127                       9:127  0   1.8T  0 raid5
loop1                         7:1    0 465.8G  0 loop
└─md127                       9:127  0   1.8T  0 raid5
loop2                         7:2    0 465.8G  0 loop
└─md126                       9:126  0 465.8G  0 raid1 /mnt/raid5
loop3                         7:3    0 465.8G  0 loop
└─md127                       9:127  0   1.8T  0 raid5
loop4                         7:4    0 465.8G  0 loop
└─md126                       9:126  0 465.8G  0 raid1 /mnt/raid5
loop5                         7:5    0 465.8G  0 loop
└─md127                       9:127  0   1.8T  0 raid5
loop6                         7:6    0 465.8G  0 loop
└─md127                       9:127  0   1.8T  0 raid5
sda                           8:0    0    20G  0 disk
└─sda1                        8:1    0    20G  0 part  /
sdc                           8:32   0   300G  0 disk
└─sdc1                        8:33   0   300G  0 part
 ├─datastore-mongodb        252:0    0   100G  0 lvm   /var/lib/mongodb
 └─datastore-elasticsearch  252:1    0   100G  0 lvm
  /var/lib/elasticsearch
sr0                          11:0    1  1024M  0 rom

py-log-01:~# pvs
 PV         VG        Fmt  Attr PSize   PFree
 /dev/sdb1  vg0       lvm2 a--    2.00t      0
 /dev/sdc1  datastore lvm2 a--  300.00g 100.00g


py-log-01:~# vgs
 VG        #PV #LV #SN Attr   VSize   VFree
 datastore   1   2   0 wz--n- 300.00g 100.00g


py-log-01:~# lvs
 LV            VG        Attr       LSize   Pool Origin Data%  Meta%  Move
Log Cpy%Sync Convert
 elasticsearch datastore -wi-ao---- 100.00g

 mongodb       datastore -wi-ao---- 100.00g







 My monitoring server:

py-mon-01:~# lsblk
NAME                                   MAJ:MIN RM  SIZE RO TYPE MOUNTPOINT
fd0                                      2:0    1    4K  0 disk
sda                                      8:0    0   30G  0 disk
└─sda1                                   8:1    0   30G  0 part /
sdb                                      8:16   0  301G  0 disk
└─sdb1                                   8:17   0  301G  0 part
 └─py--mon--01--prometheus-database    254:2    0  301G  0 lvm
 /var/lib/prometheus
sdc                                      8:32   0   55G  0 disk
└─sdc1                                   8:33   0   55G  0 part
 └─py--mon--01--postgresql-postgresql  254:1    0   55G  0 lvm
 /var/lib/postgresql
sdd                                      8:48   0  101G  0 disk
└─sdd1                                   8:49   0  101G  0 part
 └─py--mon--01--elk-elastic            254:0    0  101G  0 lvm
 /var/lib/elasticsearch

py-mon-01:~# pvs
 PV         VG                   Fmt  Attr PSize   PFree
 /dev/sdb1  py-mon-01-prometheus lvm2 a--  301.00g    0
 /dev/sdc1  py-mon-01-postgresql lvm2 a--   55.00g    0
 /dev/sdd1  py-mon-01-elk        lvm2 a--  101.00g    0

py-mon-01:~# vgs
 VG                   #PV #LV #SN Attr   VSize   VFree
 py-mon-01-elk          1   1   0 wz--n- 101.00g    0
 py-mon-01-postgresql   1   1   0 wz--n-  55.00g    0
 py-mon-01-prometheus   1   1   0 wz--n- 301.00g    0

py-mon-01:~# lvs
 LV         VG                   Attr       LSize   Pool Origin Data%
 Meta%  Move Log Cpy%Sync Convert
 elastic    py-mon-01-elk        -wi-ao---- 101.00g

 postgresql py-mon-01-postgresql -wi-ao----  55.00g

 database   py-mon-01-prometheus -wi-ao---- 301.00g



 j.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.progclub.org/pipermail/programming/attachments/20190612/6a81dc9d/attachment-0001.html>


More information about the programming mailing list