SMS уведомления в Icinga2.

Если в вашей IT-Инфраструктуре нет резервного канала интернета, или в процессе работы появились проблемы с почтовым сервером, то появляется проблема с доставкой уведомлений об авариях через e-mail. В этом случае может помочь использование SMS уведомлений средствами сотовой связи, используя обычный USB-модем.

Для настройки использовался не привязанный ни к какому оператору связи USB-модем Huawei E173.

В материале используется ОС Debian 9.5, Icinga2 версии 2.9.1-1 и Iicngaweb2 версии 2.6.1

Для работы с USB портами ставим пакет usbutils

apt update
apt install usbutils

После чего убеждаемся, что система видит USB-модем командой lsusb:


Bus 002 Device 002: ID 12d1:1c05 Huawei Technologies Co., Ltd. Broadband stick (modem on)

Установка и настройка SMS Server Tools 3

Для установки СМС сервера загружаем исходники с сайта разработчика.

Распаковываем исходники в папку

tar -xzf smstools*.tar.gz

Перейти в папку, собрать и установить исходники.

cd smstools3/
make
make install

После успешной установки переходим к настройке

nano /etc/smsd.conf

Содержимое файла заменяем, указав в 10 строке свой номер порта USB:

devices = GSM1
logfile = /var/log/smsd.log
loglevel = 7
[GSM1]
#Прием входящих сообщений 
#incoming = yes
#Пин-код сим-карты / если используется то раскомментировать
#pin = 1111
init = AT^CURC=0
device = /dev/ttyUSB0
baudrate = 19200
incoming = no
report_device_details = yes
signal_quality_ber_ignore = yes

 Перезапускаем SMS Сервер:

/etc/init.d/sms3 restart

Так же необходимо дать права на папку /var/spool/sms/outgoing пользователю, от чьего имени запущена Icinga:

chown -R root:groupname /var/spool/sms/outgoing
chmod 775 /var/spool/sms/outgoing

Проверяем работоспособность командой sendsms, где код страны указывается без знака "+":

sendsms 71234567890 "Hello, World"

На указанный номер должно прийти SMS сообщение.

Если оно не пришло то, смотрим журнал ошибок

nano /var/log/smsd.log

Настройка Icinga2 на отправку оповещений через SMS

Для отправки сообщений первым делом необходимо создать скрипты оповещения служб и оповещения узлов которые будут работать с smstools3

За основу были взяты скрипты, отвечающией за отправку Mail-уведомлений.

Готовый скрипт для оповещения служб можно скачать тут.

Готовый скрипт для оповещения узлов можно скачать тут.

Данные файлы необходимо поместить в /etc/icinga2/scripts/.

• Скрипт для оповещения служб sms-service-notification.sh

  #!/usr/bin/env bash
  PROG="`basename $0`"
  ICINGA2HOST="`hostname`"
  SMSBIN="sendsms"
  if [ -z "`which $SMSBIN`" ] ; then
  echo "$SMSBIN not found in \$PATH. Consider installing it."
  exit 1
  fi
  ## Function helpers
  Usage() {
  cat << EOF
  Required parameters:
  -d LONGDATETIME (\$icinga.long_date_time\$)
  -e SERVICENAME (\$service.name\$)
  -l HOSTNAME (\$host.name\$)
  -n HOSTDISPLAYNAME (\$host.display_name\$)
  -o SERVICEOUTPUT (\$service.output\$)
  -r USERPAGER (\$user.pager\$)
  -s SERVICESTATE (\$service.state\$)
  -t NOTIFICATIONTYPE (\$notification.type\$)
  -u SERVICEDISPLAYNAME (\$service.display_name\$)
  Optional parameters:
  -4 HOSTADDRESS (\$address\$)
  -6 HOSTADDRESS6 (\$address6\$)
  -b NOTIFICATIONAUTHORNAME (\$notification.author\$)
  -c NOTIFICATIONCOMMENT (\$notification.comment\$)
  -i ICINGAWEB2URL (\$notification_icingaweb2url\$, Default: unset)
  -f MAILFROM (\$notification_mailfrom\$)
  -v (\$notification_sendtosyslog\$, Default: false)
  EOF
  }
  Help() {
  Usage;
  exit 0;
  }
  Error() {
  if [ "$1" ]; then
  echo $1
  fi
  Usage;
  exit 1;
  }
  urlencode() {
  local LANG=C i c e=''
  for ((i=0;i<${#1};i++)); do
  c=${1:$i:1}
  [[ "$c" =~ [a-zA-Z0-9\.\~\_\-] ]] || printf -v c '%%%02X' "'$c"
  e+="$c"
  done
  echo "$e"
  }
  ## Main
  while getopts 4:6:b:c:d:e:f:hi:l:n:o:r:s:t:u:v: opt
  do
  case "$opt" in
  4) HOSTADDRESS=$OPTARG ;;
  6) HOSTADDRESS6=$OPTARG ;;
  b) NOTIFICATIONAUTHORNAME=$OPTARG ;;
  c) NOTIFICATIONCOMMENT=$OPTARG ;;
  d) LONGDATETIME=$OPTARG ;; # required
  e) SERVICENAME=$OPTARG ;; # required
  f) MAILFROM=$OPTARG ;;
  h) Usage ;;
  i) ICINGAWEB2URL=$OPTARG ;;
  l) HOSTNAME=$OPTARG ;; # required
  n) HOSTDISPLAYNAME=$OPTARG ;; # required
  o) SERVICEOUTPUT=$OPTARG ;; # required
  r) USERPAGER=$OPTARG ;; # required
  s) SERVICESTATE=$OPTARG ;; # required
  t) NOTIFICATIONTYPE=$OPTARG ;; # required
  u) SERVICEDISPLAYNAME=$OPTARG ;; # required
  v) VERBOSE=$OPTARG ;;
  \?) echo "ERROR: Invalid option -$OPTARG" >&2
  Usage ;;
  :) echo "Missing option argument for -$OPTARG" >&2
  Usage ;;
  *) echo "Unimplemented option: -$OPTARG" >&2
  Usage ;;
  esac
  done
  shift $((OPTIND - 1))
  ## Keep formatting in sync with sms-host-notification.sh
  for P in LONGDATETIME HOSTNAME HOSTDISPLAYNAME SERVICENAME SERVICEDISPLAYNAME SERVICEOUTPUT SERVICESTATE USERPAGER NOTIFICATIONTYPE ; do
  eval "PAR=\$${P}"
  if [ ! "$PAR" ] ; then
  Error "Required parameter '$P' is missing."
  fi
  done
  ## Build the message's subject
  SUBJECT="[$NOTIFICATIONTYPE] $SERVICEDISPLAYNAME on $HOSTDISPLAYNAME is $SERVICESTATE!"
  ## Build the notification message
  NOTIFICATION_MESSAGE=`cat << EOF
  $SERVICEDISPLAYNAME on $HOSTDISPLAYNAME is $SERVICESTATE! $SERVICEOUTPUT $LONGDATETIME $SERVICENAME $NOTIFICATIONCOMMENT
  EOF
  `
  ## Check whether IPv4 was specified.
  if [ -n "$HOSTADDRESS" ] ; then
  NOTIFICATION_MESSAGE="$NOTIFICATION_MESSAGE
  IPv4: $HOSTADDRESS"
  fi
  ## Check whether IPv6 was specified.
  if [ -n "$HOSTADDRESS6" ] ; then
  NOTIFICATION_MESSAGE="$NOTIFICATION_MESSAGE
  IPv6: $HOSTADDRESS6"
  fi
  ## Check whether author and comment was specified.
  if [ -n "$NOTIFICATIONCOMMENT" ] ; then
  NOTIFICATION_MESSAGE="$NOTIFICATION_MESSAGE
  Comment by $NOTIFICATIONAUTHORNAME:
  $NOTIFICATIONCOMMENT"
  fi
  ## Check whether Icinga Web 2 URL was specified.
  if [ -n "$ICINGAWEB2URL" ] ; then
  NOTIFICATION_MESSAGE="$NOTIFICATION_MESSAGE
  $ICINGAWEB2URL/monitoring/service/show?host=$(urlencode "$HOSTNAME")&service=$(urlencode "$SERVICENAME")"
  fi
  ## Check whether verbose mode was enabled and log to syslog.
  if [ "$VERBOSE" == "true" ] ; then
  logger "$PROG sends $SUBJECT => $USERPAGER"
  fi
  ## Send the SMS using the $SMSBIN command.
  if [ -n "$MAILFROM" ] ; then
  ## Modify this for your own needs!
  if [ -f /etc/debian_version ]; then
  /usr/bin/printf "%b" "$NOTIFICATION_MESSAGE" | $SMSBIN $USERPAGER
  else
  /usr/bin/printf "%b" "$NOTIFICATION_MESSAGE" | $SMSBIN $USERPAGER
  fi
  else
  /usr/bin/printf "%b" "$NOTIFICATION_MESSAGE" | $SMSBIN $USERPAGER
  fi
  

• Скрипт для оповещения узлов sms-host-notification.sh

  #!/usr/bin/env bash
  PROG="`basename $0`"
  ICINGA2HOST="`hostname`"
  SMSBIN="sendsms"
  if [ -z "`which $SMSBIN`" ] ; then
   echo "$SMSBIN not found in \$PATH. Consider installing it."
   exit 1
  fi
  ## Function helpers
  Usage() {
  cat << EOF
  Required parameters:
   -d LONGDATETIME (\$icinga.long_date_time\$)
   -l HOSTNAME (\$host.name\$)
   -n HOSTDISPLAYNAME (\$host.display_name\$)
   -o HOSTOUTPUT (\$host.output\$)
   -r USERPAGER (\$user.pager\$)
   -s HOSTSTATE (\$host.state\$)
   -t NOTIFICATIONTYPE (\$notification.type\$)
  Optional parameters:
   -4 HOSTADDRESS (\$address\$)
   -6 HOSTADDRESS6 (\$address6\$)
   -b NOTIFICATIONAUTHORNAME (\$notification.author\$)
   -c NOTIFICATIONCOMMENT (\$notification.comment\$)
   -i ICINGAWEB2URL (\$notification_icingaweb2url\$, Default: unset)
   -f MAILFROM (\$notification_mailfrom\$)
   -v (\$notification_sendtosyslog\$, Default: false)
  EOF
  }
  Help() {
   Usage;
   exit 0;
  }
  Error() {
   if [ "$1" ]; then
   echo $1
   fi
   Usage;
   exit 1;
  }
  urlencode() {
   local LANG=C i c e=''
   for ((i=0;i<${#1};i++)); do
   c=${1:$i:1}
   [[ "$c" =~ [a-zA-Z0-9\.\~\_\-] ]] || printf -v c '%%%02X' "'$c"
   e+="$c"
   done
   echo "$e"
  }
  ## Main
  while getopts 4:6::b:c:d:f:hi:l:n:o:r:s:t:v: opt
  do
   case "$opt" in
   4) HOSTADDRESS=$OPTARG ;;
   6) HOSTADDRESS6=$OPTARG ;;
   b) NOTIFICATIONAUTHORNAME=$OPTARG ;;
   c) NOTIFICATIONCOMMENT=$OPTARG ;;
   d) LONGDATETIME=$OPTARG ;; # required
   f) MAILFROM=$OPTARG ;;
   h) Help ;;
   i) ICINGAWEB2URL=$OPTARG ;;
   l) HOSTNAME=$OPTARG ;; # required
   n) HOSTDISPLAYNAME=$OPTARG ;; # required
   o) HOSTOUTPUT=$OPTARG ;; # required
   r) USERPAGER=$OPTARG ;; # required
   s) HOSTSTATE=$OPTARG ;; # required
   t) NOTIFICATIONTYPE=$OPTARG ;; # required
   v) VERBOSE=$OPTARG ;;
   \?) echo "ERROR: Invalid option -$OPTARG" >&2
   Error ;;
   :) echo "Missing option argument for -$OPTARG" >&2
   Error ;;
   *) echo "Unimplemented option: -$OPTARG" >&2
   Error ;;
   esac
  done
  shift $((OPTIND - 1))
  ## Keep formatting in sync with sms-service-notification.sh
  for P in LONGDATETIME HOSTNAME HOSTDISPLAYNAME HOSTOUTPUT HOSTSTATE USERPAGER NOTIFICATIONTYPE ; do
   eval "PAR=\$${P}"
  if [ ! "$PAR" ] ; then
   Error "Required parameter '$P' is missing."
   fi
  done
  ## Build the message's subject
  SUBJECT="[$NOTIFICATIONTYPE] Host $HOSTDISPLAYNAME is $HOSTSTATE!"
  ## Build the notification message
  NOTIFICATION_MESSAGE=`cat << EOF
  $HOSTDISPLAYNAME is $HOSTSTATE! $HOSTOUTPUT $LONGDATETIME $NOTIFICATIONCOMMENT
  EOF
  `
  ## Check whether IPv4 was specified.
  if [ -n "$HOSTADDRESS" ] ; then
   NOTIFICATION_MESSAGE="$NOTIFICATION_MESSAGE
  IPv4: $HOSTADDRESS"
  fi
  ## Check whether IPv6 was specified.
  if [ -n "$HOSTADDRESS6" ] ; then
   NOTIFICATION_MESSAGE="$NOTIFICATION_MESSAGE
  IPv6: $HOSTADDRESS6"
  fi
  ## Check whether author and comment was specified.
  if [ -n "$NOTIFICATIONCOMMENT" ] ; then
   NOTIFICATION_MESSAGE="$NOTIFICATION_MESSAGE
  Comment by $NOTIFICATIONAUTHORNAME:
   $NOTIFICATIONCOMMENT"
  fi
  ## Check whether Icinga Web 2 URL was specified.
  if [ -n "$ICINGAWEB2URL" ] ; then
   NOTIFICATION_MESSAGE="$NOTIFICATION_MESSAGE
  $ICINGAWEB2URL/monitoring/host/show?host=$(urlencode "$HOSTNAME")"
  fi
  ## Check whether verbose mode was enabled and log to syslog.
  if [ "$VERBOSE" == "true" ] ; then
   logger "$PROG sends $SUBJECT => $USEREPAGER"
  fi
  ## Send the SMS using the $SMSBIN command.
  ## If an explicit sender was specified, try to set it.
  if [ -n "$MAILFROM" ] ; then
  ## Modify this for your own needs!
  if [ -f /etc/debian_version ]; then
   /usr/bin/printf "%b" "$NOTIFICATION_MESSAGE" | $SMSBIN $USERPAGER
  else
   /usr/bin/printf "%b" "$NOTIFICATION_MESSAGE" | $SMSBIN $USERPAGER
   fi
  else
   /usr/bin/printf "%b" "$NOTIFICATION_MESSAGE" | $SMSBIN $USERPAGER
  fi
  

Далее необходимо описать работу скриптов в Icinga2

• 1. /etc/icinga2/conf.d/command.conf

  object NotificationCommand "sms-host-notification" {
   command = [ SysconfDir + "/icinga2/scripts/sms-host-notification.sh"]
  arguments += {
   "-4" = "$notification_address$"
   "-6" = "$notification_address6$"
   "-b" = "$notification_author$"
   "-c" = "$notification_comment$"
   "-d" = {
   required = true
   value = "$notification_date$"
   }
   "-f" = {
   value = "$notification_from$"
   description = "Set from address."
   }
   "-i" = "$notification_icingaweb2url$"
   "-l" = {
   required = true
   value = "$notification_hostname$"
   }
   "-n" = {
   required = true
   value = "$notification_hostdisplayname$"
   }
   "-o" = {
   required = true
   value = "$notification_hostoutput$"
   }
   "-r" = {
   required = true
   value = "$notification_userpager$"
   }
   "-s" = {
   required = true
   value = "$notification_hoststate$"
   }
   "-t" = {
   required = true
   value = "$notification_type$"
   }
   "-v" = "$notification_logtosyslog$"
   }
  vars += {
   notification_address = "$address$"
   notification_address6 = "$address6$"
   notification_author = "$notification.author$"
   notification_comment = "$notification.comment$"
   notification_type = "$notification.type$"
   notification_date = "$icinga.long_date_time$"
   notification_hostname = "$host.name$"
   notification_hostdisplayname = "$host.display_name$"
   notification_hostoutput = "$host.output$"
   notification_hoststate = "$host.state$"
   notification_userpager = "$user.pager$"
   }
  }
  object NotificationCommand "sms-service-notification" {
   command = [ SysconfDir + "/icinga2/scripts/sms-service-notification.sh" ]
  arguments += {
   "-4" = "$notification_address$"
   "-6" = "$notification_address6$"
   "-b" = "$notification_author$"
   "-c" = "$notification_comment$"
   "-d" = {
   required = true
   value = "$notification_date$"
   }
   "-e" = {
   required = true
   value = "$notification_servicename$"
   }
   "-f" = {
   value = "$notification_from$"
   description = "Set from address."
   }
   "-i" = "$notification_icingaweb2url$"
   "-l" = {
   required = true
   value = "$notification_hostname$"
   }
   "-n" = {
   required = true
   value = "$notification_hostdisplayname$"
   }
   "-o" = {
   required = true
   value = "$notification_serviceoutput$"
   }
   "-r" = {
   required = true
   value = "$notification_userpager$"
   }
   "-s" = {
   required = true
   value = "$notification_servicestate$"
   }
   "-t" = {
   required = true
   value = "$notification_type$"
   }
   "-u" = {
   required = true
   value = "$notification_servicedisplayname$"
   }
   "-v" = "$notification_logtosyslog$"
   }
  vars += {
   notification_address = "$address$"
   notification_address6 = "$address6$"
   notification_author = "$notification.author$"
   notification_comment = "$notification.comment$"
   notification_type = "$notification.type$"
   notification_date = "$icinga.long_date_time$"
   notification_hostname = "$host.name$"
   notification_hostdisplayname = "$host.display_name$"
   notification_servicename = "$service.name$"
   notification_serviceoutput = "$service.output$"
   notification_servicestate = "$service.state$"
   notification_userpager = "$user.pager$"
   notification_servicedisplayname = "$service.display_name$"
   }
  }
  

• 2. /etc/icinga2/conf.d/notifications.conf

  apply Notification "sms-icingaadmin" to Host {
   import "sms-host-notification"
   user_groups = host.vars.notification.sms.groups
   users = host.vars.notification.sms.users
   interval = 2h
   assign where host.vars.notification.sms
  }
  apply Notification "sms-icingaadmin" to Service {
   import "sms-service-notification"
   user_groups = host.vars.notification.sms.groups
   users = host.vars.notification.sms.users
   interval = 2h
   assign where host.vars.notification.sms
  }
  

• 3. /etc/icinga2/conf.d/templates.conf

  template Notification "sms-host-notification" {
   command = "sms-host-notification"
  states = [ Up, Down ]
   types = [ Problem, Acknowledgement, Recovery, Custom,
   FlappingStart, FlappingEnd,
   DowntimeRemoved ]
  vars += {
   notification_logtosyslog = false
   }
  period = "24x7"
  }
  template Notification "sms-service-notification" {
   command = "sms-service-notification"
  states = [ OK, Warning, Critical, Unknown ]
   types = [ Problem, Acknowledgement, Recovery, Custom,
   FlappingStart, FlappingEnd,
   DowntimeRemoved ]
  vars += {
   notification_logtosyslog = false
   }
  period = "24x7"
  }
  

4. Добавлем нужным пользователям переменную pager в /etc/icinga2/conf.d/users.conf:

В примере пользователь icingaadmin

object User "icingaadmin" {
import "generic-user"
display_name = "Icinga 2 Admin"
groups = [ "icingaadmins" ]
email = "some mail"
pager = "71234567890"
}

5. В конфигурации узлов и служб, о которых мы хотим получать SMS уведомление, необходимо добавить информацию о том, кого необходимо уведомлять:

  vars.notification["sms"] = {
  groups = [ "icingaadmins" ]
}

Далее проверяем конфигурацию и перезапускаем Icinga2.

service icinga2 checkconfig
service icinga2 restart

Теперь вам должны приходить SMS сообщения подобного вида:

• 
•