238 lines
6.7 KiB
Markdown
238 lines
6.7 KiB
Markdown
# Netbox agent [](https://travis-ci.com/Solvik/netbox-agent)
|
|
|
|
This project aims to create hardware automatically into [Netbox](https://github.com/netbox-community/netbox) based on standard tools (dmidecode, lldpd, parsing /sys/, etc).
|
|
|
|
The goal is to generate an existing infrastructure on Netbox and have the ability to update it regularly by executing the agent.
|
|
|
|
# Features
|
|
|
|
* Create virtual machines, servers, chassis and blade through standard tools (`dmidecode`)
|
|
* Create physical, bonding and vlan network interfaces with IPs (IPv4 & IPv6)
|
|
* Create IPMI interface if found
|
|
* Create or get existing VLAN and associate it to interfaces
|
|
* Generic ability to guess datacenters and rack location through drivers (`cmd` and `file` and custom ones)
|
|
* Update existing `Device` and `Interface`
|
|
* Handle blade moving (new slot, new chassis)
|
|
* Automatic cabling (server's interface to switch's interface) using lldp
|
|
* Local inventory using `Inventory Item` for CPU, RAM, RAID cards, physical disks (behind raid cards)
|
|
* PSUs creation and power consumption reporting (based on vendor's tools)
|
|
|
|
# Requirements
|
|
|
|
- Netbox >= 2.6
|
|
- Python >= 3.4
|
|
- [pynetbox](https://github.com/digitalocean/pynetbox/)
|
|
- [python3-netaddr](https://github.com/drkjam/netaddr)
|
|
- [python3-netifaces](https://github.com/al45tair/netifaces)
|
|
- [jsonargparse](https://github.com/omni-us/jsonargparse/)
|
|
|
|
- ethtool
|
|
- dmidecode
|
|
- ipmitool
|
|
- lldpd
|
|
- lshw
|
|
|
|
## Inventory requirement
|
|
- hpassacli
|
|
- storcli
|
|
- omreport
|
|
|
|
# Installation
|
|
|
|
```
|
|
# pip3 install netbox-agent
|
|
```
|
|
|
|
# Usage
|
|
|
|
The agent can be run from a shell and get its configuration from either the configuration file or environment variables.
|
|
|
|
Configuration values are overridden based on the following precedence: command line arguments (might include config file) > environment variables > default config file > defaults.
|
|
|
|
```
|
|
# netbox_agent -c /etc/netbox_agent.yml --register
|
|
INFO:root:Creating chassis blade (serial: QTFCQ574502EF)
|
|
INFO:root:Creating blade (serial: QTFCQ574502D2) myserver on chassis QTFCQ574502EF
|
|
INFO:root:Setting device (QTFCQ574502D2) new slot on Slot 9 (Chassis QTFCQ574502EF)..
|
|
INFO:root:Interface a8:1e:84:f2:9e:6a not found, creating..
|
|
INFO:root:Creating NIC enp1s0f1 (a8:1e:84:f2:9e:6a) on myserver
|
|
INFO:root:Interface 02:42:7a:89:cf:a4 not found, creating..
|
|
INFO:root:Creating NIC br-07ea1e4a2f0e (02:42:7a:89:cf:a4) on myserver
|
|
INFO:root:Create new IP 172.19.0.1/16 on br-07ea1e4a2f0e
|
|
INFO:root:Interface a8:1e:84:f2:9e:69 not found, creating..
|
|
INFO:root:Creating NIC enp1s0f0 (a8:1e:84:f2:9e:69) on myserver
|
|
INFO:root:Create new IP 42.42.42.42/24 on enp1s0f0
|
|
INFO:root:Create new IP fe80::aa1e:84ff:fef2:9e69/64 on enp1s0f0
|
|
INFO:root:Interface a8:1e:84:cd:9d:d6 not found, creating..
|
|
INFO:root:Creating NIC IPMI (a8:1e:84:cd:9d:d6) on myserver
|
|
INFO:root:Create new IP 10.191.122.10/24 on IPMI
|
|
```
|
|
|
|
If you need, you can update only specific informations like:
|
|
* Network
|
|
* Inventory
|
|
* Location
|
|
* PSUs
|
|
|
|
```
|
|
# ip a add 42.42.42.43/24 dev enp1s0f1
|
|
# netbox_agent -c /etc/netbox_agent.yaml --update-network
|
|
INFO:root:Create new IP 42.42.42.43/24 on enp1s0f1
|
|
# netbox_agent --update-inventory
|
|
INFO:root:Creating Disk Samsung SSD 850 S2RBNX0K101698D
|
|
```
|
|
|
|
# Configuration
|
|
|
|
```
|
|
# Netbox configuration
|
|
netbox:
|
|
url: 'http://netbox.internal.company.com'
|
|
token: supersecrettoken
|
|
|
|
# Network configuration
|
|
network:
|
|
# Regex to ignore interfaces
|
|
ignore_interfaces: "(dummy.*|docker.*)"
|
|
# Regex to ignore IP addresses
|
|
ignore_ips: (127\.0\.0\..*)
|
|
# enable auto-cabling by parsing LLDP answers
|
|
lldp: true
|
|
|
|
## Enable virtual machine support
|
|
# virtual:
|
|
# # not mandatory, can be guessed
|
|
# enabled: True
|
|
# # see https://netbox.company.com/virtualization/clusters/
|
|
# cluster_name: my_vm_cluster
|
|
|
|
# Enable datacenter location feature in Netbox
|
|
datacenter_location:
|
|
driver: "cmd:cat /etc/qualification | tr [a-z] [A-Z]"
|
|
regex: "DATACENTER: (?P<datacenter>[A-Za-z0-9]+)"
|
|
# driver: 'cmd:lldpctl'
|
|
# regex: 'SysName: .*\.([A-Za-z0-9]+)'
|
|
#
|
|
# driver: "file:/tmp/datacenter"
|
|
# regex: "(.*)"
|
|
|
|
# Enable rack location feature in Netbox
|
|
rack_location:
|
|
# driver: 'cmd:lldpctl'
|
|
# match SysName: sw-dist-a1.dc42
|
|
# regex: 'SysName:[ ]+[A-Za-z]+-[A-Za-z]+-([A-Za-z0-9]+)'
|
|
#
|
|
# driver: "file:/tmp/datacenter"
|
|
# regex: "(.*)"
|
|
|
|
# Enable local inventory reporting
|
|
inventory: true
|
|
```
|
|
|
|
# Specific workflow
|
|
|
|
## Blades
|
|
|
|
Each vendor class has a `is_blade` method which is later used for `Device` creation using the Netbox [parent/child feature](https://netbox.readthedocs.io/en/stable/core-functionality/devices/).
|
|
|
|
The `get_blade_slot` method return the name of the `Device Bay`.
|
|
|
|
|
|
Certain vendors don't report the blade slot in `dmidecode`, so we can use the `slot_location` regex feature of the configuration file.
|
|
|
|
## Anycast IP
|
|
|
|
The default behavior of the agent is to assign an interface to an IP.
|
|
So two servers with anycasted IPs, running update mode, would only trigger IP's interface assignement in a loop.
|
|
|
|
In order to handle this case, user need to set Netbox IP's mode to `Anycast` so that the agent will create another one if it's present on another server.
|
|
|
|
# Hardware
|
|
|
|
Tested on:
|
|
|
|
## Virtual Machines
|
|
|
|
* Hyper-V
|
|
* VMWare
|
|
* VirtualBox
|
|
* AWS
|
|
* GCP
|
|
|
|
## Dell Inc.
|
|
|
|
### Blades
|
|
|
|
* PowerEdge MX7000
|
|
* PowerEdge M1000e (your `DeviceType` should have slots named `Slot 01` and so on)
|
|
* PowerEdge MX740c
|
|
* PowerEdge M640
|
|
* PowerEdge M630
|
|
* PowerEdge M620
|
|
* PowerEdge M610
|
|
|
|
### Pizzas
|
|
|
|
* DSS7500
|
|
|
|
## HP / HPE
|
|
|
|
### Blades
|
|
|
|
* HP BladeSystem c7000 Enclosure G2 / G3 (your `DeviceType` should have slots named `Bay 1` and so on)
|
|
* HP ProLiant BL460c Gen8
|
|
* HP ProLiant BL460c Gen9
|
|
* HP ProLiant BL460c Gen10
|
|
|
|
### Pizzas
|
|
|
|
* ProLiant DL380p Gen8
|
|
* ProLiant SL4540 Gen8
|
|
* ProLiant SL4540 Gen9
|
|
* ProLiant XL450 Gen10
|
|
|
|
## Supermicro
|
|
|
|
### Blades
|
|
|
|
Feel free to send me a dmidecode output for Supermicro's blade!
|
|
|
|
### Pizzas
|
|
|
|
* SSG-6028R
|
|
* SYS-6018R
|
|
|
|
## QCT
|
|
|
|
### Blades
|
|
|
|
* QuantaMicro X10E-9N
|
|
|
|
### Pizzas
|
|
|
|
* Nothing ATM, feel free to send me a dmidecode or make a PR!
|
|
|
|
# Known limitations
|
|
|
|
* The project is only compatible with Linux.
|
|
Since it uses `ethtool` and parses `/sys/` directory, it's not compatible with *BSD distributions.
|
|
* Netbox `>=2.6.0,<=2.6.2` has a caching problem ; if the cache lifetime is too high, the script can get stale data after modification.
|
|
We advise to set `CACHE_TIME` to `0`.
|
|
|
|
# Developing
|
|
|
|
If you want to run the agent while adding features or just for debugging purposes
|
|
|
|
```
|
|
# git clone https://github.com/Solvik/netbox-agent.git
|
|
# cd netbox-agent
|
|
# python3 -m netbox_agent.cli --register
|
|
```
|
|
|
|
On a personal note, I use the docker image from [netbox-community/netbox-docker](https://github.com/netbox-community/netbox-docker)
|
|
```
|
|
# git clone https://github.com/netbox-community/netbox-docker
|
|
# cd netbox-docker
|
|
# docker-compose pull
|
|
# docker-compose up
|
|
```
|