ASUS KGPE-D16 Server/Workstation
TODO: OLD page. TODO: check that all the info is still valid.
Introduction
This is a server board using AMD hardware (Fam10h and Fam15h CPUs available). It can also be used for building a high-powered workstation. Powered by libreboot. The coreboot port was done by Timothy Pearson of Raptor Engineering Inc. and, working with them (and sponsoring the work), merged into libreboot.
Memory initialization is still problematic, for some modules. We recommend avoiding Kingston modules. Here are some working configurations.
Flashing instructions can be found at ../install/#flashprog - note that external flashing is required, if the proprietary (ASUS) firmware is currently installed. If you already have libreboot, by default it is possible to re-flash using software running in Linux on the KGPE-D16, without using external hardware.
CPU compatibility
Opteron 62xx and 63xx CPUs work just fine.
Board status (compatibility)
Form factor
These boards use the SSI EEB 3.61 form factor; make sure that your case supports this. This form factor is similar to E-ATX in that the size is identical, but the position of the screws are different.
IPMI iKVM module add-on
Don’t use it. It uses proprietary firmware and adds a backdoor (remote out-of-band management chip, similar to the Intel Management Engine. Fortunately, the firmware is unsigned (possibly to replace) and physically separate from the motherboard since it’s on the add-on module, which you don’t have to install.
Flash chips
2MiB flash chips are included by default, on these boards. It’s on a P-DIP 8 slot (SPI chip). The flash chip can be upgraded to higher sizes: 4MiB, 8MiB or 16MiB. With at least 8MiB, you could feasibly fit a compressed linux+initramfs image (BusyBox+Linux system) into CBFS and boot that, loading it into memory.
libreboot has configs for 2, 4, 8 and 16 MiB flash chip sizes (default flash chip is 2MiB).
DO NOT hot-swap the chip with your bare hands. Use a P-DIP 8 chip extractor. These can be found online.
This guide shows how to flash the chip:
25xx NOR flashing guide
Native graphics initialization
Only text-mode is known to work, but linux(kernel) can initialize the framebuffer display (if it has KMS - kernel mode setting).
Current issues
- LRDIMM memory modules are currently incompatible (IT MAY WORK NOWADAYS, TODO TEST)
- SAS (via PIKE 2008 module) requires a vendor option ROM (and SeaBIOS) to boot from it (theoretically possible to replace, but you can put a kernel in CBFS or on SATA and boot from that, which can be on a SAS drive. The linux kernel can use those SAS drives (via PIKE module) without an option ROM).
- SeaBIOS lacked serial console support out-of-the-box in release 20160907 and as such a workaround using SGABIOS is necessary. You can find instructions on how to do this on the Notabug issue tracker
- IPMI iKVM module (optional add-on card) uses proprietary firmware. Since it’s for remote out-of-band management, it’s theoretically a backdoor similar to the Intel Management Engine. Fortunately, unlike the ME, this firmware is unsigned which means that a free replacement is theoretically possible. For now, the libreboot project recommends not installing the module. This project might be interesting to derive from, for those who want to work on a free replacement. In practise, out-of-band management isn’t very useful anyway (or at the very least, it’s not a major inconvenience to not have it).
- Graphics: only text-mode works. See #graphics
Hardware specifications
The information here is adapted, from the ASUS website.
Processor / system bus
- 2 CPU sockets (G34 compatible)
- HyperTransport™ Technology 3.0
- CPUs supported:
- AMD Opteron 6100 series (Fam10h. No IOMMU support. Not recommended - old. See the errata datasheet
- AMD Opteron 6200 series (Fam15h, with full IOMMU support in libreboot.
- AMD Opteron 6300 series (Fam15h, with full IOMMU support in libreboot.
- 6.4 GT/s per link (triple link)
Core logic
- AMD SR5690
- AMD SP5100
Memory compatibility (with libreboot)
- Total Slots: 16 (4-channel per CPU, 8 DIMM per CPU), ECC
- Capacity: Maximum up to 256GB RDIMM (Tested max 128GB)
- Memory Type that is compatible:
- DDR3 1600/1333/1066/800 UDIMM*
- DDR3 1600/1333/1066/800 RDIMM*
- Compatible sizes per memory module:
- 16GB, 8GB, 4GB, 3GB, 2GB, 1GB RDIMM
- 8GB, 4GB, 2GB, 1GB UDIMM
Expansion slots
- Total slot: 6
- Slot Location 1: PCI 32bit/33MHz
- Slot Location 2: PCI-E x16 (Gen2 X8 Link)
- Slot Location 3: PCI-E x16 (Gen2 X16 Link), Auto switch to x8 link if slot 2 is occupied
- Slot Location 4: PCI-E x8 (Gen2 X4 Link)
- Slot Location 5: PCI-E x16 (Gen2 X16 Link)
- Slot Location 6: PCI-E x16 (Gen2 X16 Link), Auto turn off if slot 5 is occupied, For 1U FH/FL Card, MIO supported
- Additional Slot 1: PIKE slot (for SAS drives. See notes above)
- Follow SSI Location#
Form factor
- SSI EEB 3.61 (12"x13")
ASUS features
- Fan Speed Control
- Rack Ready (Rack and Pedestal dual use)
Storage
- SATA controller:
- AMD SP5100
- 6 x SATA2 300MB/s
- SAS/SATA Controller:
- ASUS PIKE2008 3Gbps 8-port SAS card included
Networking
- 2 x Intel® 82574L + 1 x Mgmt LAN
Graphics
- Aspeed AST2050 with 8MB VRAM
On board I/O
- 1 x PSU Power Connector (24-pin SSI power connector + 8-pin SSI 12V + 8-pin SSI 12V power connector)
- 1 x Management Connector , Onboard socket for management card
- 3 x USB pin header , Up to 6 Devices
- 1 x Internal A Type USB Port
- 8 x Fan Header , 4pin (3pin/4pin fan dual support)
- 2 x SMBus
- 1 x Serial Port Header
- 1 x TPM header
- 1 x PS/2 KB/MS port
Back I/O ports
- 1 x External Serial Port
- 2 x External USB Port
- 1 x VGA Port
- 2 x RJ-45
- 1 x PS/2 KB/Mouse
Environment
- Operation temperature: 10C ~ 35C
- Non operation temperature: -40C ~ 70C
- Non operation humidity: 20% ~ 90% ( Non condensing)
Monitoring
- CPU temperatures
- Fan speed (RPM)
Note:
- DDR3 1600 can only be supported with AMD Opteron 6300/6200 series processor