warewulf/CHANGELOG.md

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

[4.5.0] 2024-02-08

Added

• ability to create bonded network interfaces
• ipxe script to boot node from local disk.
• Option to change the ipmitool escape character
• New documentation for the hostlist syntax. #611
• New documentation for development environment (Vagrant)
• Ability to duplicate an image with wwctl container copy or the API
• New documentation for container duplication procedure
• Configure network device MTU in nework configuration scripts. #807
• OpenSUSE Leap build rebased to 15.5 (15.3 is EOL)
• New build for Rocky Linux 9
• Add nightly release support. #969
• Add container rename command. #583
• Add container build flags and warn message after container sync. #509
• Add DNS fields to network configuration overlays. #922
• Added support for booting nodes with grub. Enable this behavior using warewulf.grubboot: true in warewulf.conf. For unknown nodes, grub.efi and shim.efi are extracted from the Warewulf host. If the booted node has a container these binaries are extracted from the container image.

Fixed

• Make mounting of local patitions into sub-directories work
• Make Variables.mk consistent with spec file w.r.t. WWPROVISIONDIR, e.g. instead of basing in /srv, handle it the same as chroots and overlays.
• Enable spec file to work with Fedora
• Fix hard CPU architecture on proto's installation in the Makefile
• More aggressive make clean.
• Replace deprecated io.utils functions with new os functions.
• The correct header is now displayed when -al flags are specified to overlay list.
• Added a missing .ww extension to the 70-ww4-netname.rules template in the wwinit overlay.
• Restrict access to /warewulf/config to root only. (#728, #742)
• KERNEL VERSION column is too short. #690
• Add support for resolving absolute path automatically. #493
• The network device "OnBoot" parameter correctly configures the ONBOOT ifcfg parameter. (#644)
• Add support for listing profile/node via comma-separated values. #739
• Sort the node list returned entries by name.
• 'wwctl node edit' inconsistent state with warewulfd. #691
• Add --parents option to overlay import subcommand to create necessary parent folder. #608
• Fix kernelargs are not printing properly in node list output. #828
• Fix build configuration on Quickstart guide #847
• Add Quickstart guide for EL9
• Add EL9 Quickstart guide to index.rst
• Container file gids are now updated properly during syncuser. #840
• Fix build for API.
• Bindd mounts for wwctl exec are now on the same fs
• Fixed the ability to set MTU with wwctl #947
• Fixed a bug where profile tags were erroneously overridden by empty node values. #884
• Fixed bug where tags from profiles weren't rendered #967
• Fixed a bug when using wwctl container import --force to replace an existing container will generate an error #474
• Create /etc/systemd/network/10-persistent-net-<netdev>.link file per network device
• Fix the issue that the same tag added in node set is ignored. #967
• Change too-verbose warning message level from Warn to Debug. #1025
• Fixed a bug where error occurs when editing node. #1024
• Optionally detect network and netmask from CIDR IP address. #1016
• Fix startup of wwclient on systemd hosts #1066
• Change ownership of overlays to root:root #1086

Changed

• The primary hostname and warewulf server fqdn are now the canonical name in /etc/hosts
• Refactored profile add command to make it alike node add. #658 #659
• The ifcfg ONBOOT parameter is no longer statically true, so unconfigured interfaces may not be enabled by default. (#644)
• Write log messages to stderr rather than stdout. #768
• new subcommand wwctl genconf is available with following subcommands:
  • completions which will create the files used for bash-completion. Also fish an zsh completions can be generated
  • defaults which will generate a valid defaults.conf
  • man which will generate the man pages in the specified directory
  • reference which will generate a reference documentation for the wwctl commands
  • warwulfconf print which will print the used warewulf.conf. If there is no valid warewulf.conf a valid configuration is provided, prefilled with default values and an IP configuration derived from the network configuration of the host
• Added support for file systems, partitions and disks. Values for these objects can be set with wwctl profile/node set/add. The format of this objects is inspired by butane/ignition, but where butane/ignition uses lists for holding disks, partitions and file systems, warewulf uses maps instead. For disks the map key is the underlying block device, for partitions its the partition label and for file systems its the path to the partitions (e.g. /dev/disk/by-partlabel/scratch). Not all available options of butane/ignition are exposed to the commandline, but are available via wwctl node/profile edit.

Changed

• The primary hostname and warewulf server fqdn are now the canonical name in /etc/hosts
• Refactored profile add command to make it alike node add. #658 #659
• The ifcfg ONBOOT parameter is no longer statically true, so unconfigured interfaces may not be enabled by default. (#644)
• Write log messages to stderr rather than stdout. #768
• All paths can now be configured in warewulf.conf, check the paths section of of wwctl --emptyconf genconfig warewulfconf print for the available paths.
• Added experimental dnsmasq support.
• fix SIGSEV when build host has no network #907
• Check for formal correct IP and MAC addresses for command line options and when reading in the configurations
• Added template to create genders database
• Write log messages to stderr rather than stdout. #768
• Updates to Makefile for clarity, notably removing genconfig and replacing test-it with test. #890
• realy reboot also without systemd
• Specify primary network device per-node rather than per-netdev
• refactored output wwctl node/profile list so that -a will only show all the set values and -A will show all fields included the ones without a set value
• Added the template function {{ createIgnitionJson }} which will create a json object compatible with ignition.
• Container images need ignition and sgdisk installed in order to the disk management.
• Added boootup services based on ignition which will manage the disks, partitions and file systems. The services are systemd services as sgdisk needs systemd in order to work correctly. All service use the existence of /warewulf/ignition.json as perquisite so that they can be place in the wwinit overlay and will only become active if disk management is configured for this node. The service ignition-disks-ww4.service will partition and format and create the file systems on the disks. For every a file system a systemd mount unit file is create and will executed after the ignition-disks-ww4.service has finished. Entries in /etc/fstab for every file system are created with the noauto option.
• wwclient has now a commandline switch for the location of warewulf.conf
• wwctl overlay edit uses a temporary file and checks mtime.
• Changed the bash completions for the wwctl overlay commands so that the files of the overlays are expanded
• Node overlays are now named based on their overlay "context" (i.e., "system" or "runtime") rather than a concatenated list of individual overlays. This removes a limit on the number of overlays that could be included in a node or profile. #852, #876, #883, #896, #903
• During node discovery, prefer the primary network interface, if defined. #775
• added general test framework which creates temporary directories on the fly
• only write IPMI if write is true
• Don't show an error if image files for containers can't be found. #933
• Make configured paths available in overlays as .Path #960
• Introduced IPXESOURCE environment variable which allows to specify the path to iPXE binaries not provided by warewulf
• use distrubtion ipxe binaries in the rpm
• Allow absolute iPXE paths in warewulf.conf
• Support importing containers with symlinked /bin/sh #797
• Don't panic on malformed passwd #527
• Update iPXE building script
• Send Info, Recv, Send, and Out messages to stdout; and others to stderr
• grub in combination can now be set as boot method with warewulf.grubboot: true in warewulf.conf. For unknown nodes grub.efi and shim.efi will be extracted from the host running warewulf. If node has container it will get these binaries from the container image.
• overlays from different profiles for one node are now merged, overlays can be excluded with ~ prefix and in listings are listed as !{excluded_profile} #885
• modules are now correctly included
• move hostlist into internal alongside other warewulf code #804
• uniform shebang usage in scripts of init.d folder #821
• Check if commas are allowes in node/profile set
• Removed paths.tftpdir and paths.datadir
• Updated WW_INTERNAL to 45 for upcoming 4.5.x release
• Added documentation about of how to configure warewulf with multiple networks
• Added installation instructions for using dnsmasq
• Move built-in overlays to a rootfs directory #1086

[4.4.0] 2023-01-18

Added

• New Docker container node image for CentOS 7. #621

Fixed

• Replaced an invalid variable name in a NetworkManager overlay template. #626
• The 'nodes' alias now correctly refers to 'node' rather than 'profile'.
• Fixed a typo in a log message. #631
• Boolean attributes now correctly account for profile and default values. #630
• Kernel version is shown correctly for symlink'd kernels #640
• Changing a profile always adds an empty default interface. #661

[4.4.0rc3] 2022-12-23

Added

• New defaults.conf man page. #593
• A new debug overlay includes a template which demonstrates accessing all available variables. #599
• Distribute a README along with staticfiles. #189
• Add a -y flag to wwctl profile add. #610
• Distribute a source RPM with GitHub releases. #614

Changed

• No longer ask for confirmation when deleting 0 nodes. #603
• Ask for confirmation during wwctl container delete. #606

Fixed

• wwctl profile set now indicates "profiles" in output where it previously mistakenly indicated "nodes." #600
• Set correct overlay permissions for a NetworkManager configuration file. #591

Fixed

• Directories within overlays no longer lose group/other write permissions #584

[4.4.0rc2] 2022-12-09

Added

• The environment variable WW_CONTAINER_SHELL is defined in a wwctl container shell environment to indicate the container in use. #579
• Network interface configuration (ifcfg) files now include the interface name and type. #457

Fixed

• Work-around for older versions of gzip that lack a --keep flag during wwctl container build. #580
• The default ipxe template is once again specified as a built-in default and in defaults.conf. #581
• wwctl container list no longer segfaults when a container chroot is present without a built image. #585
• wwctl configure hostfile now correctly detects the presence of the hostfile overlay template. #571
• wwctl overlay build no longer panics when rendering an template for a node which has tags set. #568
• Minor typographical fixes. #569

[4.4.0rc1] 2022-10-27

Added

• iPXE binaries included with Warewulf now support VLAN tagging. #563
• wwctl container list now shows the container creation date, modification date, and size. #537
• wwctl node edit supports directly editing or defining node configuration YAML in an editor. #540
• wwctl node export and wwctl node import support importing and exporting node definitions as YAML or (for import) CSV. The CSV file must have a header in where the first field must always be the nodename, and the rest of the fields are the same as the long commandline options. Network device must have the form net.$NETNAME.$NETOPTION. (e.g., net.default.ipaddr) #540
• The warewulfd.service systemd unit file now supports execreload and execstop. #550
• Network interfaces now accept an mtu attribute. #549
• The wwinit overlay now supports network interface configuration via NetworkManager for Ethernet and InfiniBand interfaces. #539
• Default node attribute values (e.g., for kernel arguments) are now read in from a defaults.conf configuration file. If this file is not present, built-in default values are used. #539
• Warewulf documentation is now managed alongside the Warewulf source code in a single code repository so that documentation may be updated alongside code changes.
• New man pages for warewulf.conf and nodes.conf #510
• An initial cut of the Warewulf API #471
• wwctl show --render shows overlay templates as they would be rendered on a given target node. #467
• wwctl ssh now supports Bash completion. #466

Changed

• wwctl overlay edit no longer saves a new template to the overlay if the template is not modified from its initial state. #522
• The wwinit overlay now only sets a name for a network interface if that interface has a MAC address defined. #553
• wwctl container delete now also deletes the built images associated with that container. #214
• Unified internal code paths for wwctl profile and wwctl node commands, and between the on disk YAML format and the in memory format, enabling the command-line options to be autogenerated from the datastructures and ensuring that profile and node capabilities remain in sync. Multiple command line arguments have been updated or changed. #495, #637
• wwctl power commands no longer separates node output with additional whitespace. #514

Fixed

• /etc/warewulf/excludes (read from the node image) once again excludes files from being included in the node image. #532
• wwctl ssh always uses a node's primary interface. #544
• wwctl container show now correctly shows the kernel version. #542
• System users are no longer prevented from logging into compute nodes. #538
• wwctl overlay chown now correctly handles uid and gid arguments. #530
• wwctl overlay chown no longer sets gid to 0 when unspecified. #531
• Corrected the path for .wwbackup files in some situations. #524
• Bypass imgextract for legacy BIOS machines to avoid 32-bit memory limitations. #497
• warewulfd no longer panics when network interface tags are defined. #468
• The wwinit overlay now configures the network device type. #465
• Minor typographical fixes. #528, #519

[4.3.0] 2022-06-25

Added

• All configurations files for the host (/etc/exports, /etc/dhcpd.conf, /etc/hosts) are now populated from the (OVERLAYDIR/host/etc/{exports|dhcpd|hosts}.ww . Also other configuration files like prometheus.yml.ww or slurm.conf.ww which depend on the cluster nodes can be placed. Also the new templated functions {{ abort }}, {{ IncludeBlock }} abd {{ no_backup }} are allowed now.
• nodes and profiles can now have multiple system and runtime overlays, as a comma separated list. The overlays of the profile and the nodes are combined.
• simple ipv6 support is now enabled. In warewulf.conf the option ipaddr6/Ipv6net must be set to enable ipv6. If enabled on of these options is set a node will get a derived ipv6 in the scheme ipv6net:ipaddr4. This address can also be overwritten for every node
• Multiple files can now created from a single template.ww file with the {{ file FILENAME }} command in the template. The command is expanded to the magic template command {{ /* file FILENAME */}} which is picked up by wwctl and everything which comes after this magic comment will be written to the file FILENAME. This mechanism is leveraged in the configuration files for the network, see ifcfg.xml.ww and ifcgf.ww.
• Networks can now have arbitrary keys value pairs in the profiles and on the node, so that things like bridges and mtu sizes can be set
• oci container tar balls can be imported with the 'file://$PATH' scheme
• uids and gids of a container can now get synced at import time, so that at least users with the same name have the same uid. This is not necessarily needed for warewulf, but services like munge.

Changed

• Provision interface is not tied to 'eth0' any more. The provision interface must be have the 'primary' flag now. The file `nodes.conf' must be changed accordingly.
• the provisioning network is now called primary and not default
• Creating of '/etc/exports' can now be disabled, so that wwctl configure -a wont overwrite a existing '/etc/exports'.
• The yaml format for nodes has now sub-keys for ipmi and kernel, old nodes.conf files have to to be changed accordingly
• host overlays can globaly disbaled, but are enabled per default
• wwctl overlay build -H will only build the overlays which are assigned to the nodes

[4.1.0] - 2021-07-29

Added

• Support for ARM nodes
• firewalld service file for warewulfd
• -y option to skip "Are you sure" queries
• wwctl kernel delete command
• wwctl vnfs alias for wwctl container
• Support for authenticated OCI registries
• warewulfd can reload config on SIGHUP and when the config file changes
• Node database index to improve lookup speeds
• Kernels and containers can be imported from a chroot subdirectory
• Systemd service file

Changed

• wwctl node list output beautification
• Log timestamps are more precise
• PID file and log files are now in /var/run and /var/log, respectively
• make install no longer overwrites preexisting configuration files
• Kernel modules and overlays are now compressed
• rootfstype now uses rootfs in default kernel arguments
• iPXE binaries updated
• Installed container directory is deleted when import fails
• Default iPXE script now reboots erroring nodes every 15 seconds
• Only open /etc/hosts when writing

Removed

• wwctl configure --persist flags have been removed. configure commands persist changes by default unless --show is used
• In-repository documentation: has been moved to it's own repository

Fixed

• Importing containers from directory
• Debug log verbosity option takes precedence over verbose option
• wwctl node list -n output is formatted corectly
• Container names can contain an underscore
• wwctl overlay build --all does not require an argument
• specfile date format works with older versions of rpmbuild
• Use SystemOverlay when building system overlay
• dhcpd template now references correct wwctl subcommand
• wwctl node set kernelargs and wwctl profile set kernelargs change kernel arguments