View on GitHub

Open Source Cluster Application Resources

Download this project as a .zip file Download this project as a tar.gz file

Documentations > User Documentations

OSCAR_unstable Quick Start Guide for CentOS-7, AlmaLinux-8, openSUSE-15.3

  1. Notes:
    • CentOS-6 is not supported anymore due to EOL of product. Though, packages are still availlable in case they are still needed. Installation process is similar to CentOS-7 except that you need to use CentOS vault repositories: curl --output /etc/yum.repos.d/CentOS-Base.repo yum -y install epel-release-6-8.noarch curl --output /etc/yum.repos.d/epel.repo
    • This Guide can also be used for a RHEL 7 or 8 install, but it is not tested.
    • OpenSUSE-15 is newly supported and still incomplete.
  2. Install AlmaLinux-8.x or CentOS-7.x or openSUSE-15.3 or Debian-10 or Debian-11 (or their Ubuntu equivalent) base server (+ X11 if you are working localy)
  3. Setup hostname, and network.
  4. Configure and enable the required repositories:
    • CentOS-7:
      • yum -y install
      • yum -y install
    • AlmaLinux-8:
      • dnf -y install dnf-plugins-core
      • dnf config-manager --set-enabled PowerTools
      • dnf -y install epel-release
      • dnf -y install
    • openSUSE-15.3:
      • zypper install
    • Debian-10:
      • cat » /etc/apt/sources.list.d/oscar.list «EOF deb [trusted=yes] dists/buster/binary-amd64/ EOF
    • Debian-11:
      • cat » /etc/apt/sources.list.d/oscar.list «EOF deb [trusted=yes] dists/bullseye/binary-amd64/ EOF
  5. make sure that your mta (mail transfert agent) is postfix if you want mtaconfig to be of any use. if postfix is not your default mta, then do a:

    • AlmaLinux-8:
      • dnf -y install postfix; yum remove sendmail exim
    • CentOS-7:
      • yum -y install postfix; yum remove sendmail exim
    • OpenSUSE-15:
      • zypper --non-interactive install --no-recommends --download-in-advance postfix; zypper --non-interactive remove sendmail exim
    • Debian-10, Debian-11:
      • apt-get install postfix
  6. Update SELinux config (/etc/selinux/config)


  7. disable ipv6 in /etc/sysctl.conf (and reboot)

    net.ipv6.conf.all.disable_ipv6 = 1 net.ipv6.conf.default.disable_ipv6 = 1

  8. Install main oscar package:
    • AlmaLinux-8:
      • dnf -y install oscar
    • CentOS-7:
      • yum -y install oscar
    • OpenSUSE-15:
      • zypper --non-interactive install --no-recommends --download-in-advance -f oscar
  9. check /etc/oscar/oscar.conf
  10. check /etc/oscar/supported_distros.txt
  11. Configure oscar for your distro:

    CentOS-7: oscar-config --setup-distro centos-7-x86_64

    RHEL-7: oscar-config --setup-distro rhel-7-x86_64

    AlmaLinux-8: oscar-config --setup-distro almalinux-8-x86_64

    RHEL-8: oscar-config --setup-distro rhel-8-x86_64

    OpenSUSE-15: oscar-config --setup-distro opensuse-15-x86_64

  12. Bootstrapp oscar (install packages needed for your distro and do some basic configuration)

    oscar-config --bootstrap

  13. Start the OSCAR installer wizard;

    oscar_wizard -d install

  14. Wizard STEP1: Select experimental, then select: (bold means mandatory)
    • apitest
    • base
    • blcr
    • c3
    • disable-services
    • ganglia
    • jobmonarch
    • maui
    • mtaconfig
    • munge
    • naemon
    • netbootmgr
    • nfs
    • ntpconfig
    • oda
    • openmpi
    • opium
    • pvm
    • sc3
    • seliun
    • sis
    • switcher
    • sync-files
    • torque
    • yume
  15. Wizard STEP2: Configure selected oscar packages
  16. Wizard STEP3: Install Oscar server packages
    • Fix TFTP_DIR in /etc/systemimager/systemimager.conf
    • Fix server_args in /etc/xinetd.d/tftp (tftpboot dir)
    • restart si_netbootmond
    • service systemimager-server-netbootmond restart
  17. Wizard STEP4: Build Client image
  18. Wizard STEP5: Define oscar clients
  19. Wizard STEP6: Setup Networking
    • Assign macs to nodes (if used start collecting MACS, then stop it before going further)
    • Enable Install mode
    • Configure DHCP server
    • Setup Network Boot
  20. edit /etc/dhcp/dhcpd.conf
    • correct the gateway (option routers), then restart dhcpd (BUG)
    • optionally add dns infos (those entries are ommited if you’re using non routable IPs) option domain-name “”; option domain-name-servers #.#.#.#, #.#.#.#;
  21. Add postinstall scripts to configure bootloader and network (feature broken in system-configurator).

    cd /var/lib/systemimager/scripts/post-install/
    sudo wget # (Optional: will set node console keyboard to fr_FR)
    sudo wget # Edit this to update DNS config

  22. Monitor cluster deployment
  23. PXE boot all nodes
  24. Wizard STEP7: Complete cluster setup
  25. Wizard STEP8: Test cluster setup

OSCAR_unstable Quick Remove script for CentOS/RHEL/Fedora

This script is useful to restart from scratch an OSCAR Install. It’s not perfect. All files modified (with a .oscarback backup) are not restored for instance.

sudo oscar-config -t
sudo yum -y remove oscar drmaa-python ganglia* jobmonarch* "ganglia*" \ 
                   "jobmonarch*" "*torque*" "*openmpi*" "*systemimager*" \ 
                   netbootmgr opkgc perl-Qt atftp-server dhcp \
                   modules-default-manpath-oscar modules-oscar perl-OSCAR \
                   "naemon*" "nagios*" nrpe "postgresql" "rrdtool*" "httpd*" \
                   "slurm*" oscar-installer openmpi-switcher-modulefile
sudo rm -rf /etc/oscar \
            /etc/ganglia \
            /etc/naemon \
            /etc/systemimager \
            /etc/systeminstaller \
            /var/log/oscar \
            /var/lib/oscar \