Difference between revisions of "Tomato"

From Nuclear Physics Group Documentation Pages
Jump to navigationJump to search
 
(26 intermediate revisions by 3 users not shown)
Line 1: Line 1:
== General Information ==
+
The hostname Tomato is currently being used for the rackmount server which was previously known as [[Einstein]]. <strike>If you're looking for information about the system formerly known as Tomato, it has been renamed [[Okra]].</strike>
Tomato does some VPN stuff with Xemed.
 
  
Hostnames: <code>tomato.unh.edu</code>, <code>tomato.farm.physics.unh.edu</code>
+
Currently tomato isn't used for anything critical, but it does serve as a secondary [[DNS]] server and [[VMWare]] host.
  
== Network Configuration ==
+
= Hardware Information =
Currently has ethernet cable to switch for local (farm) connection, and an ethernet cable to the wall for unh connection.
+
[[Image:H8SMU_spec.jpg |right| SuperMicro H8SMU Motherboard ]]
=== /etc/sysconfig/network-scripts/ifcfg-bohr_tun ===
+
* Motherboard: [http://www.supermicro.com/Aplus/motherboard/Opteron1000/MCP55/H8SMU.cfm SuperMicro H8SMU]
DEVICE=bohr_tun
+
** nVidia MCP55-Pro chipset
TYPE="GRE Tunnel"
+
** SAS Backplane: SAS825TQ
DEVICETYPE=gre
+
*Dual-Core AMD Opteron 1218 Processor
BOOTPROTO=none
+
*4 GB 333 MHz DDR Memory
ONBOOT=yes
+
*Marvell Technology Group Ltd. MV88SX6081 8-port SATA II PCI-X
USERCTL=no
+
*Two NVIDIA MCP55 Integrated Gigabit Ethernet Ports
+
*Matshita DVD-ROM
MY_IPADDR=132.177.88.76
+
*ATI ES1000 Video
MY_PRIVATE_NET=10.0.0.0/24
+
 
+
 
PEER_IPADDR=132.177.88.174
+
 
=== /etc/sysconfig/network-scripts/ifcfg-dirac_tun ===
+
[http://nuclear.unh.edu/wiki/pdfs/motherboards/MNL-H8SMU_10a.pdf Motherboard User Manual]
DEVICE=dirac_tun
+
 
TYPE="GRE Tunnel"
+
= Network Configuration =
DEVICETYPE=gre
+
Tomato has an ethernet cable connected to the switch for local (farm) connection, and uses a [[VLAN|vlan]] configuration for the connection to the external (unh) network.
BOOTPROTO=none
+
 
ONBOOT=yes
+
* IP address UNH: 132.177.88.52 (eth1)
USERCTL=no
+
* IP address Farm: 10.0.0.248 (eth0)
+
* IP address IPMI: 10.0.0.148
MY_IPADDR=132.177.88.76
+
 
MY_PRIVATE_NET=10.0.0.0/24
+
=Software and Services=
+
 
PEER_IPADDR=132.177.88.51
+
This section contains details about the services and software on Gourd and information about their configurations.  
=== /etc/sysconfig/network-scripts/ifcfg-ennui_tun ===
+
 
DEVICE=ennui_tun
+
== IPTables ==
TYPE="GRE Tunnel"
+
 
DEVICETYPE=gre
+
Tomato uses the standard NPG [[iptables]] firewall. Gourd allows ssh, icmp, portmap and nfs connections.
BOOTPROTO=none
+
 
ONBOOT=yes
+
==NFS Shares==
USERCTL=no
+
 
+
Tomato serves two volumes over [[NFS]]. They are located at /data0 and /data1. They are accessible via [[automount]] in /net/tomato on our systems.
MY_OUTER_IPADDR=132.177.88.76
+
 
MY_INNER_IPADDR=10.0.3.1
+
===/etc/exports===
  MY_PRIVATE_NET=10.0.0.0/24
+
<pre>
+
  /data0 @servers(rw,sync) @npg_clients(rw,sync) \
PEER_OUTER_IPADDR=132.177.91.252
+
        10.0.0.0/24(rw,sync)
PEER_INNER_IPADDR=10.0.3.2
 
=== /etc/sysconfig/network-scripts/ifcfg-eth1 ===
 
DEVICE=eth1
 
BOOTPROTO=dhcp
 
HWADDR=00:E0:81:05:30:0F
 
ONBOOT=no
 
TYPE=Ethernet
 
DHCP_HOSTNAME=tomato.unh.edu
 
=== /etc/sysconfig/network-scripts/ifcfg-farm ===
 
DEVICE=farm
 
BOOTPROTO=static
 
HWADDR=00:02:B3:D3:FE:12
 
IPADDR=10.0.0.251
 
NETMASK=255.255.255.0
 
ONBOOT=yes
 
TYPE=Ethernet
 
=== /etc/sysconfig/network-scripts/ifcfg-farm:1 ===
 
DEVICE=farm:1
 
ONPARENT=yes
 
BOOTPROTO=static
 
IPADDR=10.0.0.1
 
NETMASK=255.255.255.255
 
=== /etc/sysconfig/network-scripts/ifcfg-improv_tun ===
 
DEVICE=improv_tun
 
  TYPE="GRE Tunnel"
 
  DEVICETYPE=gre
 
BOOTPROTO=none
 
ONBOOT=yes
 
USERCTL=no
 
 
MY_OUTER_IPADDR=132.177.88.183
 
MY_INNER_IPADDR=132.177.88.183
 
MY_PRIVATE_NET=10.0.0.0/24
 
 
   
 
   
  PEER_IPADDR=132.177.88.53
+
  /data1 @servers(rw,sync) @npg_clients(rw,sync) \
=== /etc/sysconfig/network-scripts/ifcfg-lo ===
+
10.0.0.0/24(rw,sync)
  DEVICE=lo
 
IPADDR=127.0.0.1
 
NETMASK=255.0.0.0
 
NETWORK=127.0.0.0
 
# If you're having problems with gated making 127.0.0.0/8 a martian,
 
# you can change this to something else (255.255.255.255, for example)
 
BROADCAST=127.255.255.255
 
ONBOOT=yes
 
NAME=loopback
 
=== /etc/sysconfig/network-scripts/ifcfg-pauli_tun ===
 
DEVICE=pauli_tun
 
TYPE="GRE Tunnel"
 
DEVICETYPE=gre
 
BOOTPROTO=none
 
ONBOOT=yes
 
USERCTL=no
 
 
MY_OUTER_IPADDR=132.177.88.183
 
MY_INNER_IPADDR=132.177.88.183
 
MY_PRIVATE_NET=10.0.0.0/24
 
 
PEER_IPADDR=132.177.88.54
 
=== /etc/sysconfig/network-scripts/ifcfg-unh ===
 
DEVICE=unh
 
BOOTPROTO=static
 
BROADCAST=132.177.91.255
 
HWADDR=00:E0:81:05:30:0E
 
IPADDR=132.177.88.76
 
NETMASK=255.255.252.0
 
NETWORK=132.177.88.0
 
ONBOOT=yes
 
TYPE=Ethernet
 
=== /etc/sysconfig/network-scripts/ifcfg-unh:1 ===
 
DEVICE=unh:1
 
ONPARENT=yes
 
BOOTPROTO=static
 
IPADDR=132.177.88.183
 
NETMASK=255.255.255.255
 
== Access Configuration ==
 
=== /etc/security/access.conf ===
 
<pre>
 
 
</pre>
 
</pre>
 +
 +
==VMWare==
 +
 +
Tomato is running [[VMWare]] Server version 2.0.2. It acts as a secondary virtualization server. The VMWare management interface is accessible at https://tomato.unh.edu:8333/ or from localhost:8222 if you're logged in or port forwarding over SSH.
 +
 +
The VMWare datastore is located in /data0/vmware
 +
 +
===Guest VMs===
 +
 +
*[[corn]] - Bugzilla bug tracker
 +
 +
= Disks and Raid Configuration =
 +
 +
Due to issues with the HD controller card in Tomato we are only using the bottom four hard drive bays, which are connected directly to SATA port on the motherboard.
 +
 +
'''Disks and Raid configuration'''
 +
{| style="wikitable;"  border="1"
 +
! Drive Bay !! Disk Size !! Raid Type !! Raid level
 +
|-
 +
| 1 || 750 GB || Software RAID || Raid 1
 +
|-
 +
| 2 || 750 GB || Software RAID || Raid 1
 +
|-
 +
| 3 || 400 GB || Software RAID || Raid 1
 +
|-
 +
| 4 || 400 GB || Software RAID || Raid 1
 +
|}
 +
<br/>
 +
 +
'''Volume Set and Partition configuration'''
 +
{| style="wikitable;"  border="1"
 +
! Raid device !! Volume set !! Volume size !! Mount Point
 +
|-
 +
| /dev/md0 &nbsp; || sdb1 & sdc1 || 50 GB || System (/)
 +
|-
 +
| /dev/md1 &nbsp; || sdb2 & sdc2 || 630 GB || /data0
 +
|-
 +
| /dev/md2 &nbsp; || sda1 & sdd1 || 343 GB || /data1
 +
|}
 +
 +
= Special Considerations for Einstein (Historical) =
 +
This information no longer applies and is here for historical reasons. We no longer use amavisd, and so these instructions are not useful.
 +
 +
 +
Einstein is our mail server. That means it runs '''"amavisd"''' (a virus scanner) and '''"spamassasin"''' a spam filter. Both these codes have some issues with leaving junk around, slowly causing the "/" file system to fill up. When that happens, einstein stops functioning.
 +
 +
Some cleanup can be done as follows:
 +
* stop amavisd and spamassasin:
 +
service amavisd stop
 +
service spamassasin stop
 +
* clean out some of their junk:
 +
rm /var/amavis/.razor/razor-agent.log
 +
touch /var/amavis/.razor/razor-agent.log
 +
chown amavis:amavis /var/amavis/.razor/razor-agent.log
 +
chmod o-r /var/amavis/.razor/razor-agent.log
 +
rm -f /var/virusmails/*  # (Sometimes there are so many, you have to delete in "chunks")
 +
rm -rf /tmp
 +
* start up the mail stuff again.
 +
service amavisd start
 +
service spamassasin start
 +
 +
There may be other areas that can be clean up, as in all the archived mail from "mailman"? But at least this list will let einstein function again.
 +
 +
== Hot Swap Information ==
 +
* Interesting thread to get sata-nv to hotswap: ([http://www.linuxquestions.org/questions/linux-hardware-18/sata-hotplug-hotswap-howto-570811])
 +
** There are drivers available for the MB sata, we could try them: [ftp://ftp.supermicro.com/driver/SATA/nVidia/MCP55/Linux/Non_RAID/Redhat/1.23/ Super Micro MB H8SMU drivers], BUT these appear to be standard Nvidia sata_nv driver.
 +
* SAS Backplane: SAS825TQ
 +
* SAT2-MV8 8-port SATA controller. Uses the sata-mv module which is NOT HOTPLUG CAPABLE. (see http://linux-ata.org/driver-status.html#matrix). THE ONLY WAY TO "HOT PLUG" with this driver is to dismount ALL the drives, then "modprobe -r sata-mv" (make sure it is really gone: lsmod | grep sata) then do the swap, then "modeprobe sata-mv" again.

Latest revision as of 20:15, 22 September 2014

The hostname Tomato is currently being used for the rackmount server which was previously known as Einstein. If you're looking for information about the system formerly known as Tomato, it has been renamed Okra.

Currently tomato isn't used for anything critical, but it does serve as a secondary DNS server and VMWare host.

Hardware Information

SuperMicro H8SMU Motherboard
  • Motherboard: SuperMicro H8SMU
    • nVidia MCP55-Pro chipset
    • SAS Backplane: SAS825TQ
  • Dual-Core AMD Opteron 1218 Processor
  • 4 GB 333 MHz DDR Memory
  • Marvell Technology Group Ltd. MV88SX6081 8-port SATA II PCI-X
  • Two NVIDIA MCP55 Integrated Gigabit Ethernet Ports
  • Matshita DVD-ROM
  • ATI ES1000 Video


Motherboard User Manual

Network Configuration

Tomato has an ethernet cable connected to the switch for local (farm) connection, and uses a vlan configuration for the connection to the external (unh) network.

  • IP address UNH: 132.177.88.52 (eth1)
  • IP address Farm: 10.0.0.248 (eth0)
  • IP address IPMI: 10.0.0.148

Software and Services

This section contains details about the services and software on Gourd and information about their configurations.

IPTables

Tomato uses the standard NPG iptables firewall. Gourd allows ssh, icmp, portmap and nfs connections.

NFS Shares

Tomato serves two volumes over NFS. They are located at /data0 and /data1. They are accessible via automount in /net/tomato on our systems.

/etc/exports

 /data0  @servers(rw,sync) @npg_clients(rw,sync) \
         10.0.0.0/24(rw,sync)
 
 /data1	 @servers(rw,sync) @npg_clients(rw,sync) \
 	 10.0.0.0/24(rw,sync)

VMWare

Tomato is running VMWare Server version 2.0.2. It acts as a secondary virtualization server. The VMWare management interface is accessible at https://tomato.unh.edu:8333/ or from localhost:8222 if you're logged in or port forwarding over SSH.

The VMWare datastore is located in /data0/vmware

Guest VMs

  • corn - Bugzilla bug tracker

Disks and Raid Configuration

Due to issues with the HD controller card in Tomato we are only using the bottom four hard drive bays, which are connected directly to SATA port on the motherboard.

Disks and Raid configuration

Drive Bay Disk Size Raid Type Raid level
1 750 GB Software RAID Raid 1
2 750 GB Software RAID Raid 1
3 400 GB Software RAID Raid 1
4 400 GB Software RAID Raid 1


Volume Set and Partition configuration

Raid device Volume set Volume size Mount Point
/dev/md0   sdb1 & sdc1 50 GB System (/)
/dev/md1   sdb2 & sdc2 630 GB /data0
/dev/md2   sda1 & sdd1 343 GB /data1

Special Considerations for Einstein (Historical)

This information no longer applies and is here for historical reasons. We no longer use amavisd, and so these instructions are not useful.


Einstein is our mail server. That means it runs "amavisd" (a virus scanner) and "spamassasin" a spam filter. Both these codes have some issues with leaving junk around, slowly causing the "/" file system to fill up. When that happens, einstein stops functioning.

Some cleanup can be done as follows:

  • stop amavisd and spamassasin:
service amavisd stop
service spamassasin stop
  • clean out some of their junk:
rm /var/amavis/.razor/razor-agent.log 
touch /var/amavis/.razor/razor-agent.log 
chown amavis:amavis /var/amavis/.razor/razor-agent.log
chmod o-r /var/amavis/.razor/razor-agent.log
rm -f /var/virusmails/*   # (Sometimes there are so many, you have to delete in "chunks")
rm -rf /tmp
  • start up the mail stuff again.
service amavisd start
service spamassasin start

There may be other areas that can be clean up, as in all the archived mail from "mailman"? But at least this list will let einstein function again.

Hot Swap Information

  • Interesting thread to get sata-nv to hotswap: ([1])
    • There are drivers available for the MB sata, we could try them: Super Micro MB H8SMU drivers, BUT these appear to be standard Nvidia sata_nv driver.
  • SAS Backplane: SAS825TQ
  • SAT2-MV8 8-port SATA controller. Uses the sata-mv module which is NOT HOTPLUG CAPABLE. (see http://linux-ata.org/driver-status.html#matrix). THE ONLY WAY TO "HOT PLUG" with this driver is to dismount ALL the drives, then "modprobe -r sata-mv" (make sure it is really gone: lsmod | grep sata) then do the swap, then "modeprobe sata-mv" again.