Jump to content
Search In
  • More options...
Find results that contain...
Find results in...
JulianC14

20Gbps Infiniband Backbone Network (PTP)

Recommended Posts

Posted · Original PosterOP

Hello people of LinusTechTips forums.. I have a project i am working on currently and would like assistance with one 'small' thing.

 

My objective is to have a 20Gb/sec link between each of my servers and my pc. I have just purchased an apple xserve and have an old pc to turn into an archive server. What i would like to know is if anyone has experience setting up infiniband on mac os, and if i should change to ubuntu server or whatever. I have little experience with enterprise networking but feel confident about setting my servers up and running them.

Link to post
Share on other sites

Followed this cause I'm interested in infiniband as well but know nothing about its good and bad :D


Use this guide to fix text problems in your postGo here and here for all your power supply needs

 

New Build Currently Under Construction! See here!!!! -----> 

 

Spoiler

Deathwatch:[CPU I7 4790K @ 4.5GHz][RAM TEAM VULCAN 16 GB 1600][MB ASRock Z97 Anniversary][GPU XFX Radeon RX 480 8GB][STORAGE 250GB SAMSUNG EVO SSD Samsung 2TB HDD 2TB WD External Drive][COOLER Cooler Master Hyper 212 Evo][PSU Cooler Master 650M][Case Thermaltake Core V31]

Spoiler

Cupid:[CPU Core 2 Duo E8600 3.33GHz][RAM 3 GB DDR2][750GB Samsung 2.5" HDD/HDD Seagate 80GB SATA/Samsung 80GB IDE/WD 325GB IDE][MB Acer M1641][CASE Antec][[PSU Altec 425 Watt][GPU Radeon HD 4890 1GB][TP-Link 54MBps Wireless Card]

Spoiler

Carlile: [CPU 2x Pentium 3 1.4GHz][MB ASUS TR-DLS][RAM 2x 512MB DDR ECC Registered][GPU Nvidia TNT2 Pro][PSU Enermax][HDD 1 IDE 160GB, 4 SCSI 70GB][RAID CARD Dell Perc 3]

Spoiler

Zeonnight [CPU AMD Athlon x2 4400][GPU Sapphire Radeon 4650 1GB][RAM 2GB DDR2]

Spoiler

Server [CPU 2x Xeon L5630][PSU Dell Poweredge 850w][HDD 1 SATA 160GB, 3 SAS 146GB][RAID CARD Dell Perc 6i]

Spoiler

Kero [CPU Pentium 1 133Mhz] [GPU Cirrus Logic LCD 1MB Graphics Controller] [Ram 48MB ][HDD 1.4GB Hitachi IDE]

Spoiler

Mining Rig: [CPU Athlon 64 X2 4400+][GPUS 9 RX 560s, 2 RX 570][HDD 160GB something][RAM 8GBs DDR3][PSUs 1 Thermaltake 700w, 2 Delta 900w 120v Server modded]

RAINBOWS!!!

 

 QUOTE ME SO I CAN SEE YOUR REPLYS!!!!

Link to post
Share on other sites

Have some experience with Infiniband but I am yet to see any Mac OSX drivers for Infiniband cards.  They are mostly for 'enterprise' operating systems and rarely cover workstation OS for full feature support.

Depending on what you are doing for the project regarding software stack etc, iWarp/RDMA is an alternative to Infiniband which may offer you some other options for hardware acceleration.


Please quote or tag me if you need a reply

Link to post
Share on other sites

I'd be more concerned with the systems you're connecting together being able to utilize a 20gb pipe (a bit less if you're adding ip traffic to it).


Desktop: MSI Z370M Gaming Pro | 8700k | 32GB Corsair Vengence 3000 | 1080 Ti | 2x 960 Pro 1TB | Corsair AX760 | Acer Predator X34 | 2x Dell U2415

Laptop: HP ZBook 17 G4 | i7-7820hq | 16GB | P3000 | 1080P | 1TB 600P | 500GB 850 EVO

Laptop: Dell XPS 13 9343 | i5-5200u | 8GB DDR3 | 256GB SSD | 4k Touchsceen

Laptop: HP Elitebook Folio G1 | M7-6Y75 | 8GB LPDDR3 | 600p 512GB SSD | FHD Touchsceen

Server(ESXi): Supermicro | 2x E5-2640v2 | 128GB DDR3 ECC 

Server(ESXi): Tyan | 2x E5-2640v2 | 128GB DDR3 ECC 

Nas: QNAP TVS-EC880 | E3-1246v3 | 16GB | 8x 3TB RAID6 | 2x 128GB SSD (system)

Nas: QNAP TS-EC1679U-RP | E3-1225v2 | 32GB | 8x 2TB 850 Pro RAID6 | 4x 60GB SSD RAID6 (system)

Nas: QNAP TS-451+ | J1900 | 8GB | 4x 4TB RAID6 (offsite backup)

Link to post
Share on other sites

I stay away from infiniband entirely, getting IP over infiniband is spotty. And as above, drivers are usually a pain or don't exist at all.


Comb it with a brick

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now


×