We've Been Doing it WRONG - Server Room Update Early 2023

[jakkuh_t]

 

[emosun]

if you're doing it wrong , i'd love for you guys to see how i do it lol. i got ye old stacked usb hard drives in the closet method going strong

[Im_Flick]

What OS will you guys be using for the HA servers? 

[SmokieRat]

Could the 3D file for the sonopan to rockwall adapter be posted here?

[Just.Oblivious]

I would love to see a video explaining your actual IT infrastructure, not just the boxes and cables

 

Like do you have AD-joined machines to provision software and set policies, or is it all just standalone boxes with local accounts? How do you ensure endpoints have the proper security controls in place?

 

Does LMG or Labs make use of infrastructure-as-code to deploy things (e.g. Ansible)? Is there something like GitLab running to manage source code and automate deployments?

 

How is the network laid out between the different entities and locations, like routes and stuff? How do the firewalls perform at 10G+ speeds with policies in place?

 

And as someone who works in IT security: have you considered setting up centralized log management, EDR, SIEM, NIDS, etc. now that the company is growing towards more of an enterprise scale?

 

This stuff might be a bit too technical for the general LTT audience, but I'm still curious to know.

[darknessblade]

Entire Whonnic in a intel nuc

 

Lets dub  it the WHYNUC

[gypsye]

Giveaway of the old graveyard servers pretty please? :D

[lywellyn]

9 hours ago, Just.Oblivious said:

I would love to see a video explaining your actual IT infrastructure, not just the boxes and cables

 

Like do you have AD-joined machines to provision software and set policies, or is it all just standalone boxes with local accounts? How do you ensure endpoints have the proper security controls in place?

 

Does LMG or Labs make use of infrastructure-as-code to deploy things (e.g. Ansible)? Is there something like GitLab running to manage source code and automate deployments?

 

How is the network laid out between the different entities and locations, like routes and stuff? How do the firewalls perform at 10G+ speeds with policies in place?

 

And as someone who works in IT security: have you considered setting up centralized log management, EDR, SIEM, NIDS, etc. now that the company is growing towards more of an enterprise scale?

 

This stuff might be a bit too technical for the general LTT audience, but I'm still curious to know.

This! I too work in IT and would love more in-depth knowledge of the logical infrastructure rather than the physical. I typically work with small businesses, but I've worked with some larger ones in the past that require some of the things you likely do now and would be interested to know how you guys do it.
Also, for the record, your IT infrastructure job you mentioned on the WAN show a few weeks back would have been my dream job but for needing to move to Canada. Can't move the family just now.  Still love hearing about all the equipment you guys use. Keep it up!

[kokosnh]

There's a orange warning diode flashing on your CLAYTON server , check it out, why it's there.

[DarkSwordsman]

7:10 WOO! PROXMOX LOVE!

[IJsklontNL]

Great to see you using the Supermicro GrandTwin! What network connectivity are you using for these, which OCP nic's?

[-BattleSheep-]

Why are you guys opting for fiber for these short distances? Consider using DAC cables instead. Actually, you should use DAC cables for any distance within reasonable limits. DAC cables are faster than fiber, consume less power, generate less heat, and have lower latency as they don't need to convert electrical signals to light and back again. And I'm not referring to a bundle of Ethernet SFPs either.

[mynameisjuan]

5 hours ago, FireBean8504 said:

Actually, you should use DAC cables for any distance within reasonable limits

Passive/active DACs have their limits, 7/15m respectively and pushing either near their max reduces reliability. AOC isn't worth mentioning because it has no benefits and more problems then simply going fiber. A DAC's reasonable limits should be within the rack and no more.

 

5 hours ago, FireBean8504 said:

DAC cables are faster than fiber, consume less power, generate less heat, and have lower latency

Less power consumption and heat yes, those are legit and undeniable benefits. The only one I would add is cost, but that gap is shrinking.

 

Lower latency ("faster" as the result of lower latency), not so much. With passive you're talking double to low triple digit picoseconds of propagation/serialization latency savings with P-DACs. Unless you're in the HFT field or DC where every propagation latency matters due to poorly coded applications and large 7+ stage Clos designs, the latency savings/performance improvements are essentially moot.

 

So while you may save on a small bit of cost, heat and power, you now have to deal with other issues that DACs face:

- Large, heavy and stiff cables with large bend radius'. Only gets worse going to 5m+

- Can introduce a lot of strain of the SFP cage

- Doesn't take many before airflow can be impacted

- Due to lack of cable management due to stiffness, replacement of intermediate equipment can require removing obstructing DACs. Pain to work with in general.

- Many report issues with interop between vendors and difficulty get properly codeded ends.

- P-DACs (only ones worth it) can be extremely sensitive to movement and environment

- Upgrades require replacing the entire runs

- Reduces any benefit of interbay panels

 

Overall, it's better just to stick with fiber (better yet SM for seamless upgrades) if the budget allows. But when you're dealing with 100g and the aggregate cost of all equipment is well into 6-figures and beyond, is it really worth it to save $500-2000 in the end?

[dogwitch]

if you follow the series.

they have had to get serious on battery back ups. due to worsen power issues.

i have done the same thing now.

was using 450 watt ups on some nas.

upgraded to 1000 watt ones.

 

on power /flicker i 100% understand!

[fulminemizzega]

I do not know why I stopped noticing the outro theme, but this time I noticed it. I think I had forgotten it, but man it never gets old.

Too much infrastructure you've become too big.

[danwat1234]

15:30 Don't suppose you would consider running Folding@home or similar Distributed Computing like WCG on that 256-core Genoa in low priority!

I don't recall if you have a full synced backup of Whonnock, just partials? 

[Cedric 97400]

Hi everybody!

I would like to know if Wifi 7 will be use in a future deployment in LTT buildings and how it works.

Is it an update possible?

Thanks a lot for your answer.

I really enjoy the video. 

 

 I am in the boxes and cables deployment and i really enjoy that.

 

We have to deploy in an hotel with 5 floors and I which to use a similar architecture.

We wich to reduce the number of cables. 

The difference will be a switch in every floor to reduce the number of cable.

The router at 1st floor.

10GB looks great for each floor. 

Then distribution with small end poe switches.

it will be awsome.

:)