Background:
I own an old server (i7-2700k+32Go RAM+5x16To in RAID5) for my homelab who serve multipurpose sus as NAS and hypervisor using proxmox.
I wanted to replace this server with the storaxa kickstarter campaign, but nothing go as planned.
So my target is to mimic the storaxa specs or even surpass it but on 1U server size.
The Old hardware:
- Intel i7-2700K
- 4x8Go 2133MHz CL10 DDR3
- PBZ77-V LX
- QNAP QM2-4P-384
- 1x10Gb SFP+ intel 82599ES
- 5x16To Seagate Exos X16
- 2x500Go NVMe Crusial CT500P5SSD8
- 1x500Go Samsung SSD 860 EVO
- 850w PSU Corsair RM850x
The New one (for the moment) :
- Intel i7-1280P
- 2x32Go 3200Mhz CL22 DDR4
- Framework Laptop 13 Mainboard (12th Gen Intel® Core™) BIOS beta 3.06
- QNAP QM2-4P-384 - Connected with:
+ TH3P4G3 (aliexpress /item/1005006130580555.html)
+ ELUTENG PCI-E 16x 3.0 Riser Cable Extension ( amazon /dp/B0B4DRHNC1) NEEDED to get full 4 NVMe
- 2x10GbE Intel X540-T2 (aliexpress /item/1005006268866821.html) - Connected with:
+ USB4 M.2 NVMe Enclosure 40Gbps ASM2464PD (aliexpress /item/1005006185746371.html)
+ M.2 to PCI-E x4 (aliexpress /item/1005004714035083.html)
- 10 ports SATA 6Gbps JMB575 + ASM1166 (aliexpress /item/1005005608262040.html) - Connected with:
+ M.2 A+E key to PCI-E x4 (aliexpress /item/4000207687691.html) (Working at PCI-E x1 speed)
- ORICO 6 in 1 USB 3.0 Hub with 4K HDMI, 2.5G Ethernet, PD 100W, 2 USB-A 3.0 Ports, 1 USB-C 3.0 Port (amazon /dp/B0BN7D63QD)
- 1x2.5GbE (aliexpress /item/1005003432672849.html)
- 5x16To ST16000NM001G
- 4x2To Kioxia Exceria Plus G2
- 1x2To Samsung SSD 990 PRO
- 1x500Go Samsung SSD 860 EVO
- 850w PSU Corsair RM850x
In testing:
- Power switch ATX-PS01 - Connected with :
+ Dual PSU Power Supply 24-Pin ATX Motherboard Adapter Cable (amazon /dp/B09B9GHFXJ) NEED to remove ATX power switch from TH3P4G3
- Simple power switch (amazon /dp/B0B2DKQH8Y) - Connected with :
+ Dual PSU Power Supply 24-Pin ATX Motherboard Adapter Cable (amazon /dp/B09B9GHFXJ)
- Radiator Fan Speed Controller 8x4-Pin PWM Fan (amazon /dp/B0C1CK3PV5)
- 5xARCTIC S4028-15K (amazon /dp/B09RK541T1)
- 350w PSU SilverStone FX350-G (amazon /dp/B07BVTT69K)
- Inter-Tech IPC 1U-10248 (amazon /dp/B00O234MNC)
- 10 ports SATA 6Gbps JMB575 + ASM1166 on :
+ 10Gbps M.2 NVMe SSD Enclosure Adapter (with M.2 to PCI-E x4)
+ 20Gbps M.2 NVMe SSD Enclosure Adapter (with M.2 to PCI-E x4)
- 2xUSB3.0 to 20pin (aliexpress /item/32436028406.html)
- ADT-Link R43UH 4.0 (aliexpress /item/1005006203494468.html)
- Carte Riser PCIe X16 to X8 + 2xM.2 (aliexpress /item/1005006666999472.html)
- Carte Riser PCIe X16 to 4xM.2 (aliexpress /item/1005006651677875.html)
- TH3P4G3 PCI bifucation support ?
- ASM2464PD PCI bifucation support ?
Untested (yet) but surely better afterway:
- TZT Graphics Card Dock External GPU Dock (aliexpress /item/1005005472156508.html) - Why :
+ Support power delivery up to 60w (if i'm understand corretly)
+ Free the 24-Pin ATX connector so i can plug my ATX-PS01 or directly a power switch.
- Car charger connected with CPU 12V (aliexpress /item/1005006149289861.html) - Why :
+ Using another USB4 M.2 NVMe Enclosure 40Gbps ASM2464PD to be least expensive
+ Free the 24-Pin ATX connector so i can plug my ATX-PS01 or directly a power switch.
- 2x10GbE Intel X550-T2 (aliexpress /item/1005006147612535.html) - Why :
+ Lower power comsummation : 8.16W instead of 14.28W (43% less)
+ PCI-E x4 instead of PCI-E x8 (limited? to x4 by Thunderbolt/USB4 connection)
+ unfortunatly more costy 144.94€ instead of 18.13€ (nearly 8 time more)
- 1x10Gb SFP+ TEG-10GECSFP - Why :
+ Lower power comsummation : 1.5W instead of 14.28W (89.5% less)
+ PCI-E x4 instead of PCI-E x8 (limited? to x4 by Thunderbolt/USB4 connection)
+ unfortunatly more costy 92.95€ instead of 18.13€ (nearly 5.13 time more)
+ only 1 port but if 2 aren't needed
+ Useful link : forums.servethehome /index.php?threads/best-low-power-sfp-cards.25824/
- 2x10Gb SFP+ Intel x710-DA2 - Why :
+ Lower power comsummation : 3.7W (Direct Attach) instead of 14.28W (74% less)
+ unfortunatly more costy 110€ (OEM & used) instead of 18.13€ (nearly 6.06 time more)
+ Useful link : forums.servethehome /index.php?threads/list-of-nics-and-their-equivalent-oem-parts.20974/
+ Useful link : reddit /r/homelab/comments/16wupb5/low_power_10gbe_nic/
+ Useful link : github /bibigon812/xl710-unlocker/tree/master
- SK hynix Gold P31 M.2 NVMe SSD - Why :
+ Lower power comsummation max : 6.3W instead of 11.09W [Kioxia Exceria Plus G2] (43.2% less)
Tested but no good for me:
- ORICO 40Gbps M.2 NVMe SSD Enclosure Adapter - Why :
+ Fan don't works well with open air and noisy
+ more expensive at the moment
- UT3G - Why :
+ Don't support power delivery the mainboard, only 15w
- M2 PCIe B+M Network Controller Card to RJ45 10GbE AQC107 - Why :
+ Unstable speed
+ seem very poorly made
+ expensive
- 6 ports SATA 6Gbps ASM1166 M.2 (aliexpress /item/1005005732198321.html) - Why :
+ don't work on 10Gbps M.2 NVMe SSD Enclosure Adapter
+ don't work on 20Gbps M.2 NVMe SSD Enclosure Adapter
Power consummation :
- For information :
+ 5x16To ST16000NM001G are in Standby_z power condition 99% of the time
* Tuned with : /usr/bin/openSeaChest/openSeaChest_PowerControl -d /dev/sg4 --EPCfeature enable
* Tuned with : /usr/bin/openSeaChest/openSeaChest_PowerControl -d /dev/sg4 --idle_b 15000 --idle_c 90000 --standby_z 1800000
* Tuned with : /usr/bin/openSeaChest/openSeaChest_Configure -d /dev/sg4 --lowCurrentSpinup low # can be set to "ultra" if needed (need testing)
* Tuned with : /usr/bin/openSeaChest/openSeaChest_Configure -d /dev/sg4 --puisFeature enable
* Only used for seedbox, plex and backup
* Useful link : forum.pine64 /showthread.php?tid=7193
+ 1x2To Samsung SSD 990 PRO is in idle 99% of the time (cache for HDD)
+ TH3P4G3 is power on 100% of the time
+ USB4 M.2 NVMe Enclosure 40Gbps ASM2464PD is power on 100% of the time
+ Intel i7-1280P is using powersave governor
+ powertop not in --auto-tune (SATA disk become unavailable if use)
+ From testing : QNAP QM2-4P-384 with 4x2To Kioxia Exceria Plus G2 use 8.5W in idle (on a standard motherboard)
+ Lower package C state : C2
- Max consummation : 143.9W
- Mean consummation : 63.3W (4.809KwH / 3 days,4 hours)
- Min consummation : 55.5W
To be improved :
- Lack of WOL due to poor designed TH3P4G3 who only power the mainboard if 5v powered or force powered:
+ Maybe the FBSL-5P connector can help but i don't even know what kind of connectique it is and how using it
- Fit all in a 1U rack 48cm dept (cf In testing part)
- Reduce the power consummation even more
- proper power on and off switch with or without power delivery :
+ Maybe one day this one will be purchasable (community.frame.work /t/atx-psu-controller-for-framework-mainboard-in-traditional-case/22352/1)
+ Maybe one day this one will get a full front panel connector (community.frame.work /t/input-connector-shim-for-power-switch-usb-2-0-and-leds/21430)
Help needed :
- Unable to reath lower than C2 power state in package
- How to connect TH3P4G3 FBSL-5P ?
For people who don’t own a framework, you may want considering others solutions:
- https://mattgadient.com/7-watts-idle-on-intel-12th-13th-gen-the-foundation-for-building-a-low-power-server-nas/
- https://nascompares.com/2024/02/23/updated-best-cpumotherboard-combo-for-your-m-itx-nas-build-ecc-pcie-gen-5-4x4-nvme-and-more/
- Minisforum MS-01 (store.minisforum /en/products/ms-01)
