Karanlık

We’ve NEVER done this before… - Mother Vault Part 1 - JBOD

Linus Tech Tips
görünümler 1 660 558
99% 61 000 1

Bilim ve Teknoloji

katma

 

29 Oca 2023

Paylaş:

Paylaş:

Herunterladen:

Yük bağlantısı.....

Ekle:

Çalma listem
Daha sonra izle
YORUMLAR 2 484
fnm04
fnm04 7 aylar önce
At this point they may as well make a server for all the footage of them installing more servers
FrizzleTits
FrizzleTits 3 aylar önce
One dedicated hard drive on a external dock in a glass casein the front office
Tyler Jackson
Tyler Jackson 4 aylar önce
Lol this is there 5th server right? Or 4th?
Carlos
Carlos 5 aylar önce
That's on the server.
Prydzen
Prydzen 6 aylar önce
@Milo- 4k is only common for TVs. According to steam suvery 66% has 1080p. ONLY 10% has 1440p and less than 3% has 2160p. So you were saying?
Milo-
Milo- 6 aylar önce
@Prydzen In 5/10 years that number will be way higher. 4K used to be very rare in households 10 years ago and crazy expensive like 8K today. And now in 2022 you can get a cheap 4k Tv voor $400/500 this was impossible 10 years ago.
QuestGiver
QuestGiver 7 aylar önce
In the grim darkness of 2025, Linus tech tips finds itself barely recognizable as thousands of servers coat their buildings like a 2 meter thick layer of armor, shielding the world from the madman at it's heart. Inside the asylum, a monument to the sins of Linus' technology addiction, he slaves away streaming 24/7 as he tries in vain to "save the universe" in sever project after server project. His employees are wired directly into everything as little more than motherboards waiting to be dropped by Linus. As time goes by, Linus will himself finally become the master of the internet as he wires himself into his temple of tech tips, continually giving tips about tech so arcane that they are lost upon the ears of the masses. In the year 2025, Linus tech tips becomes unknowable, unrecognizable, feared, and worshipped.
lionrampant31
lionrampant31 Aylar önce
Linus Shock
shaleana
shaleana 5 aylar önce
Linus Tech Tips becomes Skynet!
andrew m
andrew m 5 aylar önce
Please write a novel in this universe
Max Chan
Max Chan 6 aylar önce
Should they ever have that many servers, one they would be in some sort of business relation with ServeTheHome, and two their location would be called a datacenter not a studio.
Jason Galloway
Jason Galloway 6 aylar önce
@MajStealth this is how the golden age of technology begins.....
MarkusTegelane
MarkusTegelane 6 aylar önce
"It’s all just one drive" Little did Linus know, he was promoting Microsoft’s cloud storage solution
Sakara123
Sakara123 7 aylar önce
These videos are truly genius. As a company they need to upgrade things, so they go way overboard and it makes an awesome video showing some unique tech configs we wouldn't otherwise see. They get sponsors to send in components for free, sponsorspots sold on the video and ad-revenue from the video it self. The epitome of efficiency.
Trevor Harrison
Trevor Harrison Aylar önce
Linus, I am local (Burnaby) and would love the help do your storage management. Get in touch I have my FreeNAAS home server but no backup due to money. But I can make your system drastically reduce the chances of data loss. Get in touch
Christian Edwards
Christian Edwards 7 aylar önce
Linus always building some insane stuff for our entertainment even if it has no feasible uses for us... kudos
woswas denni
woswas denni 7 aylar önce
speak for yourself iam currently concepting a 2petabyte storage
Michael Cranfield
Michael Cranfield 7 aylar önce
like me with an Intel i7 5820k. just upgraded to 3080ti FE. why? idk just cuz. CPU bottleneck like crazy over here.
­­­Empty
­­­Empty 7 aylar önce
I am working in the IT department of a bigger company. For people like us it is always interesting what other companies are using and how they are using it. So it has a use for a lot of people 😉
Coding & Classic Gaming
But It Is Fun And Entertaining To Watch Plus Kinda Informative To People Like Me Cause My Occupation Is Close To What Linus Mostly Covers
OverkillSD
OverkillSD 6 aylar önce
What do you do that's not overkill? Well, almost everything I'd say, and I'm a bit of an expert on the subject :) I say this with love, but LTT never fails to make me cringe by how absolutely wrong they're doing an expensive project in order to avoid spending additional money. Even after your sh** broke and you've gotten to this point, you're still doing SATA drives and ZFS instead of SAS with Ceph. The sadist in me looks forward to watching you have to deal with drive failures and subsequent replacements in the future!
OverkillSD
OverkillSD 6 aylar önce
@TheRedScourge they literally said SATA and ZFS though.
TheRedScourge
TheRedScourge 6 aylar önce
They literally said this system uses SAS drives and CEPH tho
Bumbo Boy
Bumbo Boy 7 aylar önce
It's very cool but from what I've heard LTT has like 50 employees. This is like 26 Terabytes per person if you are doing a 1-to-1 backup (and not all employees will utilize this fully). Perhaps LTT has a larger data inefficiency/clean-up issue? A media company of this size should not/does not need this much storage. It's definitely cool but it seems like for the past year or so we've been getting server upgrades pretty often. It seems like a bandaid solution to a larger problem IMO. It may be in LTT's best interest moving forward to hire someone to establish standardized procedures around data retention and general operational efficiency. If these things weren't sponsored like they are LTT would be breaking the bank just trying to keep up with its data problem.
TigerXtrm
TigerXtrm 6 aylar önce
@Ashleigh Rowe So valuable that they literally just said they didn't have access to it for over a year and didn't care.
MrMotofy
MrMotofy 6 aylar önce
I don't think you understand how much footage 8k recordings are. I go on vacation and bring back 40GB, but now I can upload while on vacation
Ashleigh Rowe
Ashleigh Rowe 6 aylar önce
you are aware that they keep all old video footage for archival purposes, right? A media company this large, i'm actually surprised they're *only* using those Petabytes. yes, they could delete their old footage, and to be honest, for archival really going to tape would be cheaper and in their best interest, but they've not got a data retention problem, they just have a lot of data that is considered to be relatively valuable to LTT
MH
MH 6 aylar önce
Installing these in Lab 2 is quite an ingenious idea considering one of Lab 2's key features is its insane power infrastructure. Then just run 40Gbit or something fiber back to Lab 1 :D
VeeroRith
VeeroRith 7 aylar önce
I love how every time linus picks something heavy/expensive up you can hear everyone in the background collectively have a mild panic moment
Ascii Photo & Video
Ascii Photo & Video 7 aylar önce
"The first petabyte project was built in 2015" Me: *freezes half way through eating* "... 7 years?!?! What have I done with my life!?"
Daniel Lee
Daniel Lee 6 aylar önce
well, no it was mid 2017. the first "vault" was built in 2015. before that, there was "ruskin" which was retired during the move to the new office.
Jared Hoagland
Jared Hoagland 6 aylar önce
@EngineeringVision Whether or not you lost those years was entirely up to you.
banegas04
banegas04 6 aylar önce
i have done nothing
Arthur
Arthur 6 aylar önce
2015 somehow feels recent and forever ago at the same time.
EngineeringVision
EngineeringVision 6 aylar önce
@Psyko Blood 2 years of Pandemic (lost life)
ShmubDub
ShmubDub 7 aylar önce
At this point they literally just need to have a data center building with all their storage servers lol
kibblewhite
kibblewhite 7 aylar önce
Finally, they are doing it right, I've seen so many of their setups and thought, well if that works best for you and the team, then cool. But I always thought in the back of my head, that they really should separate the storage and compute and have the storage compatible to where you can swap out the compute unit and continue to roll without downtime. Your storage is starting to look strong now LTT, sweet !! ❤️
Archaon88
Archaon88 5 aylar önce
Going from something like glusterfs to what's effectively just a single file server really isn't an upgrade. However if downtime isn't a particular issue and there's no need for clustering etc then it's an ok solution that's much easier to manage, and sometimes that's more important than how good the tech is.
Crow’s Garage
Crow’s Garage 4 saatler önce
i love how linus is the owner of this business, but acts like an employee that dgaf when handling the extremely expensive equipment he comes across while making videos. funny watching the employees actually cringe while the owner well acts like he dgaf lol.
The Perpetual Pot
The Perpetual Pot 7 aylar önce
I Absolutely love these storage videos!
Jeff Geerling
Jeff Geerling 7 aylar önce
Next year, I'm expecting to see the same thing, in flash storage 🤪 The crazy thing is, you could put more storage per unit right now. It would just cost about 30x more lol
Jeff Geerling
Jeff Geerling 6 aylar önce
@Shadowarez "We moved into the ocean"
Shadowarez
Shadowarez 6 aylar önce
@Cheesy Duck so what I'm hearing is "we bought the entire block" video then they just move to a bigger building turn existing HQ into a storage farm with all the backup servers and employ full building water-cooling 🤣
Cheesy Duck
Cheesy Duck 6 aylar önce
@Shadowarez or get a warehouse for it lol because that room needs to get un insulated and ndeeds to be bigger.
Shadowarez
Shadowarez 6 aylar önce
I'm expecting by end of 2030 Linus will rip out the server room and just install a Very super computer or maybe one of the first Quantum cpu based servers with petabyte SSDs.
BGTheLoser
BGTheLoser 6 aylar önce
That’d only cost around 3 million dollars no big deal lol
The Burrito
The Burrito 7 aylar önce
"You can fix anything... with money." Said with such dejection from a man that literally throws money at *all* of his problems.
Brian Dickerson
Brian Dickerson 6 aylar önce
Linus doesn't throw money at his problems - he drops it on his problems.
Maighstir
Maighstir 7 aylar önce
As long as the sponsors are willing to throw their money at his problems, it's fine. If they're not, there's a slight problem.
AzureObserver
AzureObserver 7 aylar önce
Finally, they are doing it. Hope this solution works for you. I've been using a slightly more refined version of this and it's been working OK. Really glad you are finally considering merging the vault and wannick together. Once you've set that up correctly it should be much better/easier to manage.
Xaeta Core
Xaeta Core 7 aylar önce
You guys go trough more storage solutions than your average ISP in a year
rayjaymor
rayjaymor 6 aylar önce
To be fair that's a bit like saying that the courier company down the road goes through more tyres than the local racing team in a year. The use cases that an ISP has for storage solutions is completely different to these guys. The amount of video content they produce (and need multiple people working on) is pretty full on. A better comparison is to look at media production companies, and let me tell you: those guys really REALLY pour through drives. Especially for their achival stuff now that tape backups are actually more expensive than hard drives are now.
Zipp4Everyone
Zipp4Everyone 6 gün önce
Would be really nice to have it able to flash an led for damaged drives directly in the JBOD.
Sebastian Turner
Sebastian Turner 7 aylar önce
The amount of times he has said “not one, not two, but three” It just shows how big things are getting at LTT
Drivefäster4ü
Drivefäster4ü 7 aylar önce
@Alejandro Gonzales I agree
8Bit Shadow
8Bit Shadow 7 aylar önce
soon it's going to be LTTT
New Horizons
New Horizons 7 aylar önce
And expensive. Enterprise level storage... Yet not, is still damn expensive.
Nick K
Nick K 7 aylar önce
testes...testes....1....2....3?
Alejandro Gonzales
Alejandro Gonzales 7 aylar önce
Gabe Newell could learn a lot here!
G Four Gadget
G Four Gadget 7 aylar önce
LTT, part time TRvidr, full time storage hogger 😂
Ridge Tech Gaming
Ridge Tech Gaming 4 aylar önce
i love watching the server videos these guys make cause it got me interested in doing a career in servers. Currently in taking my classes now, so exciting.
Lord Traust
Lord Traust 7 aylar önce
I love these types of videos where we see some of the serious tech that is used for data storage and you could come across working in the IT world
VdevoV
VdevoV 7 aylar önce
23:18 - I remember having my mind absolutely blown with the NetApp E5600A and DE6600’s years ago that had this same feature. Not only the density at the time (60 drives in 4U), but also the drawer that was still in operation when pulled was insane. Also had optical LED channels from each individual drive interface board going to the front panel. So cool.
CoreFlood
CoreFlood 7 aylar önce
What boggles my mind is that despite it being a known issue for years and despite spending so much money on so many other projects... you guys still haven't hired a full time system administrator?
Brawndo
Brawndo 6 aylar önce
yeah they are big enough to have at least 1 full time sys admin.
Shausen 117
Shausen 117 6 aylar önce
If their gross turnover is a couple mil a year, wages a mil, other costs another mil or so, why would they spend 50 to 80k gross (benefits and tax etc) on another employee, when they dont need a SA? Heck, it would be crap, but they could reclaim old footage off YT, a SA shouldnt be their priority when they are too small to need it and alot of these guys have familiarity with system administration.
DarkAbyss9
DarkAbyss9 6 aylar önce
@bigpod small scale and needed a challenge. Sounds like someone managed mum and dads server at home and thought they were a sysadmin
bigpod
bigpod 6 aylar önce
@DarkAbyss9 also fun fact i have experiance with small scale sysadmin stuff but i switched to software dev as i needed a challenge
DarkAbyss9
DarkAbyss9 6 aylar önce
@bigpod so you've got no idea what it takes to be a sysadmin. Got it, thanks for confirming. You like Linus, we get it. That doesn't make him immune to criticism. He's not a sysadmin and his hacked together solutions based on his sponsorships and what he can make videos on doesn't change that.
Mike Caldera
Mike Caldera 7 aylar önce
Connect that sm drives directly to the APC battery backup and do (9) disk vdev array of zfs3 aka raid-z3. 10 vdevs Oracle has a good white paper of optimum zfs. Also don't use windows use proxmox. Zpool1, Zpool2,Zpool3,...Zpool9
Sourove Kummar Saha
Sourove Kummar Saha 7 aylar önce
Watching Linus build things which I will NEVER BUY IN MY ENTIRE LIFE is so satisfying!
Keiland Cooper
Keiland Cooper 6 aylar önce
It would be awesome if you did a video on how you organize ~2PB worth of files. It seems everyone has their own scheme, and to see what you all have come up with would be useful.
Locutus von Borg
Locutus von Borg 6 aylar önce
you know, jake is awsome, he seems like a guy ur telling how u wanna rob a bank and suddenly he is more into it than you were before. i like his understatement energy. calm, but with FORCE.
Mc_Awesome99
Mc_Awesome99 7 aylar önce
One day it’d be cool if you guys made a video covering ALL the servers you guys have ever had dating back to the original. Covering all the names, capacity, reason for upgrading, all that stuff, that’d be awesome!
Gjermund Skogstad Lingås
@Max Chan I'm sure Ryan from lvl1techs would be good at roasting as well :)
Max Chan
Max Chan 6 aylar önce
And bring in ServeTheHome with his actual experience doing server maintenance to roast them.
kiss peter
kiss peter 7 aylar önce
If i were Linus i would do a cold storage , with Ultrium tapes . They are denser and can hold data for long periods of time 15 years+ ,no problem
Lewayne G
Lewayne G 6 aylar önce
should have done tape a lot more than than just talk a little about it. a library would have back up everything.
Mustache Music
Mustache Music 6 aylar önce
Let's take a moment to appreciate the fact that the 1000 watts quoted here is powerful enough to run most small push style lawn mowers
Archaon88
Archaon88 5 aylar önce
Relative to the size of the system, it's not that much power since it's literally just spinning up disks plus minimal power for the SAS IO module and expanders, IPMI board etc. You can use more than that in a 1U server or a workstation if you want to. Couple of Xeons or Epycs and a couple of GPUs and you're already past that.
Matthew Jenkinson
Matthew Jenkinson 6 aylar önce
In terms of power density per RU, this is small bikkies. Start adding Instinct or Tesla cards and you can triple or more that desnity. Two racks of servers is the rough equivalent of the power available to a small electric farm tractor.
Don Ramon
Don Ramon 7 aylar önce
I wanna see them doing a project with multiple of those 100TB SSD's that Linus only made 1 video about.
Ellipsis115
Ellipsis115 10 gün önce
21:37 I wanna hear more about this probability analysis, I wanna be able to do that for my own server
Tousif Raza
Tousif Raza 7 aylar önce
*Everytime Linus needs a new server* : "WE HAVE A SERIOUS PROBLEM"
Tousif Raza
Tousif Raza 6 aylar önce
@MH What's Moore's law, only law Linus knows is "Serious problem law"
Divyam Maheshwari
Divyam Maheshwari 6 aylar önce
@MH true lol
MH
MH 6 aylar önce
Moore's Law can't keep up with LTT's data collection :)
Divyam Maheshwari
Divyam Maheshwari 6 aylar önce
Lol true 😅
Jagpreet Singh Sahi
Jagpreet Singh Sahi 7 aylar önce
That is most of us when we need something new ;p
MRNOFILTER718
MRNOFILTER718 6 aylar önce
You guys are insane and I like it. Keep up the good content!!
Andreas Weigl
Andreas Weigl 7 aylar önce
Would love to see Linus reaction to a fully deployed Dell PowerScale.
Aaron Cody
Aaron Cody 7 aylar önce
I'm surprised you didn't go the JBOD path a long time ago. The sheer magnitude capability and flexibility it allows is amazing.
LimitedBrainChill
LimitedBrainChill 7 aylar önce
Recently, I haven't been liking the non-descriptive titles. However, I find that the video itself is usually very good. I love how you used an ethernet cable as a make shift whip!
Travis Holt
Travis Holt 7 aylar önce
The LTT screwdriver is the LTT equivalent of Intel's Arc GPU's. "Coming soon"
Travis Holt
Travis Holt 6 aylar önce
@Usama Rasheed ☠️💀
Travis Holt
Travis Holt 6 aylar önce
@Mi go for real tho.
Mi go
Mi go 7 aylar önce
@Susanna umm... sounds like jealousy. There's nothing wrong with him or working for him, at all whatsoever from what you've said
Usama Rasheed
Usama Rasheed 7 aylar önce
Emotional damage
nick longstaffe
nick longstaffe 7 aylar önce
@BikeLife o for sure, but without it, I just don't see a massive advantage for the ratcheting mechanism. But I'm not constantly assembling computers, and id imagine it was designed mostly for that where tourqe settings wouldn't be hugely advantageous, especially given the cons and complexity of adding a tourqe mechanism,
Xboy
Xboy 7 aylar önce
4:27 this part when when linus pulls the server rack out , it sounds like a minecraft piston block
Logan
Logan 6 aylar önce
I love that you have finally done a episode on jbod and head server. I have been looking into this for a home or small business. There is not much on you tube on this that clearly show you how to build a home or a small business level. Would you ever considering on doing a episode on how to build both jbod and a head server and how to connect them.
Archaon88
Archaon88 5 aylar önce
Obviously depends on capacity or number of drives but for home or small business you would normally use internal disks. A server chassis with say 12x 3.5" drive bays and internal SAS or SATA controllers is way cheaper to buy than a server + JBOD + external SAS + cabling, it's less to worry about, less space, less power, etc. Also to be blunt if it's just file storage, then unless you want to nerd out for the sake of it - just go and buy a NAS from someone like QNAP or Synology.
Beardy Record Box
Beardy Record Box 7 aylar önce
Love the bit at 1:57 where Jake clearly couldn't wait for Linus to finish his intro and tried to surreptitiously get the box open. 🤣
CrakkaJac
CrakkaJac 6 aylar önce
at 2:00 he stares deeply at the box cutter wishing he had it LUL
Geoff Seeley
Geoff Seeley 7 aylar önce
Glad to see LTT using some awesome Supermicro hardware!
Innocent_Bystander
Innocent_Bystander 7 aylar önce
Depending on the controller, you might be able to at least light up a particular drive. If you rely on labeling, you're relying on anyone that puts their hand on it to properly label.
Jacob Samdal
Jacob Samdal 7 aylar önce
Honestly these segways to the sponsor just never get old. I still just get blindsided by them and dont know when theyre coming. And I laugh about everytime. And then I skip through the ad but i mean its still good stuff.
ytdlgandalf
ytdlgandalf 7 aylar önce
Scaling up will keep you busy every year. Go scaleout like ceph, or go home. With all its incredible merits, you will hit a brick wall with single node ZFS. You not having ceph or glusterfs staff is a valid reason, but your troubles with ZFS are not exactly encouraging. You could opt to let professionals take over. Yeah they cost $$$, so does fucking around with your precious data.
linuxguy 11
linuxguy 11 7 aylar önce
8:56 SAMTEC and many others make connectors like those, they are usually called board-to-board interconnects or backplane connectors. Supermicro no doubt made (or had someone make) them custom for that and their other servers.
haha name go brrr
haha name go brrr 7 aylar önce
Linus in 2024 : The MOTHER VAULT is completely FULL!
Charles Gibson
Charles Gibson 7 aylar önce
you mean Q4 2022 at the rate they are ingesting. lol
Tiggy Teccas
Tiggy Teccas 7 aylar önce
@joesumbody12 the grandmother vault
Shawn Williams
Shawn Williams 7 aylar önce
@MDG509 it would be a feat considering the size and weight of the thing lmao
MDG509
MDG509 7 aylar önce
@Shawn Williams sure… someone
Shawn Williams
Shawn Williams 7 aylar önce
Linus in February 2023: Someone DROPPED The MOTHER VAULT!!
Ikxi - Forever a Tatsunoko
3:30 that's an amazing rubberized underside on the mousepad, something this heavy on it and the mousepad doesn't slide
PuffTheDargon
PuffTheDargon 7 aylar önce
Also the nice thing is that you can set a drive light to blink a different color so if you have DC staff they know what drive to take out also.
T NS
T NS 7 aylar önce
The person who works on this should have the honorary title of "The Mother Vaulter"
Nathan Chan
Nathan Chan 6 aylar önce
I enjoy watching these videos, but with all your building expansions, how have you not built a legit server room? Talking about all the airflow, heat storage, power capacity, proper cable management? Sounds like a whole video SERIES in itself. ;)
blackraen
blackraen 7 aylar önce
12:19 Biggest thing I have to deal with as a datacenter Storage Admin is constantly checking people that assume Storage doesn't need lots of host resources. Perfectly competent technical people somehow miss that processing and handling IO isn't free in terms of system resources, both at the Storage System AND Host Initiator sides. 20:20 Metadata dedicated is a godsend for huge fileservers like yours -- The idea is that filesystem metadata lookup is actually a really big performance hit because metadata reads/writes are very small, very random, and usually with a sync_required status so they hold up the line. With a metadata tier, you put all your metadata in a dedicated high performance tier/pool/spam/whatever and it not only speeds up your metadata activity, but it also keeps your other storage open for regular IO without having to shudder around working those small metadata IO packets in the middle of regular workload.
pewpewpew
pewpewpew 6 aylar önce
@Drew we run JBOF/all flash, so each drive is 200.000 iops 4k for older systems, and more for newer, from a hw perspective, with zfs they just hang around chilling waiting for cpu, 7f52, ice lake.. same same, breaking 15-20GBs is hard even for larger files. (qsfp28/56 backend). On spinning drives its another story
Drew
Drew 6 aylar önce
@pewpewpew I don't know man, our Xeon Storinator ZFS never goes over 10% CPU. We don't use snapshots, VMs or anything fancy on it.
Paul Hughes
Paul Hughes 6 aylar önce
@Jonathan Buzzard My resume's got FAANGs but you don't see me bragging.
Jonathan Buzzard
Jonathan Buzzard 6 aylar önce
@Paul Hughes Problem with that theory is that they have over many videos showed a total lack of understanding about PB scale storage. What you see as they lurch from one disaster to the next is them slowly learning stuff that those like myself with the hard won experience have known for years or even decades. Consequently the only reasonable conclusion is they indeed don't know better. However as I said previously that's not surprising as when doing PB scale storage almost everything you think you know about storage is wrong.
Paul Hughes
Paul Hughes 6 aylar önce
@Jonathan Buzzard I'm pretty sure they did the 100TB of flash storage as both a meme and to show bigger numbers, not because they don't know better.
costafilh0
costafilh0 7 aylar önce
So... you don't have redundancy AC in the server room? that's basic! and a simple second ar/or third mini spliter inverter would be enough to never have to worry about it. Just let it on, and when the temps are ok it will turn off the AC and just blow air, not making any huge difference in the energy costs. I would just use two or three and over dimension them so they run on minimal power always and if one or two fail one would still be enough. Much cheaper than risking all the expensive hardware because of temps.
Tyler Jackson
Tyler Jackson 4 aylar önce
New server? Has 3 other servers already? No problem! 🤣🤣 I love these guys
Tyler Jackson
Tyler Jackson 4 aylar önce
New server? Has 3 other servers already? No problem! 🤣🤣 I love these guys
BlendPiNexus
BlendPiNexus 7 aylar önce
i always get excited when i hear a server doing a cold start and all the fans go jet fighter mode.
Moortu
Moortu 7 aylar önce
I'm expecting them to build their own cloud solution in a year.
aiskef33
aiskef33 6 aylar önce
@Ubermidget2 Ceph always wins..
transatlant1c
transatlant1c 7 aylar önce
If they go with trueness core rather than scale, cinder is an option which would then potentially open the door to an internal openstack deployment, I can think of a few interesting applications for such a thing at LTT.
Ubermidget2
Ubermidget2 7 aylar önce
The funny thing is, the Clustering Tech Linus specifically said they wouldn't be using (Ceph) is the gold standard for Cloud Storage, scaling to dozens of PB. At the moment, Technology is keeping up with Linus' demands; he can keep scaling up harder to get more storage. At some point he'll have to scale out. And there, Ceph will be waiting
Fibie007
Fibie007 7 aylar önce
@Administrator WSV I am with you, but you know why this is and that it, though reluctantly, has an understandable reason for it.
alset333
alset333 7 aylar önce
I hope not... AWS and Backblaze have them beat easily due to scale. The advantage of a big server is the local speeds are not limited by any ISPs
iron
iron 6 aylar önce
Longhorn is actually very nice for k8s cluster storage. Its very user friendly, even if you don't have the certification in clusterology that is required for Ceph.
Boris Vokladski
Boris Vokladski 7 aylar önce
I only watch LTT because of the overkill and extreme PC and server building videos + it is always fun to watch.
Akin Turhan
Akin Turhan 3 aylar önce
I wonder if they have ever thought about a LTO Tape drive system for archival backup
Andi Archer
Andi Archer 7 aylar önce
I hope youi thought about strengthening the rack for when you pull that draw out, its going to put hell of a stress on the frame.
Proud Dad
Proud Dad 7 aylar önce
“We built this million dollar computer” - never heard from again after two videos “Here’s another three and a half petabytes of raw storage”
batt3ryac1d
batt3ryac1d 7 aylar önce
@Bartimayus people really don't pay attention huh he mentioned in that video that they were borrowing it to show it off for the video lol.
Bartimayus
Bartimayus 7 aylar önce
@Arklan Uth Oslin The million dollar server isn't theirs to keep. And Jakes hasn't had the time
martinarcand1
martinarcand1 7 aylar önce
@Arklan Uth Oslin on the WAN show they mentioned Jake was busy working on the house + replacing staff on sick(?) leave
Washell Wash
Washell Wash 7 aylar önce
From memory, that was the production server. This is the archival storage server.
Simon
Simon 7 aylar önce
@Arklan Uth Oslin Yeah, just wondered the same thing and looked through the comments for an explanation. I mean the other one was just 2-3 month ago?!
Execu71ve
Execu71ve 6 aylar önce
I love how when Linus and Jake disagree on the number of drives, Jake just goes and looks at the wall
Innocent Kithinji
Innocent Kithinji 7 aylar önce
Everytime @Linus Tech Tips does these videos I always remember the image of a huge 5mb disk in 1960 compared to a 1TB micro sd today and wonder if in the future they will be looking at Linus build Petabytes of storage server while they have thousands at the palm of their hands 😆
Ryan Walker
Ryan Walker 7 aylar önce
Pretty much every larger enterprise storage requires 208v. In example, Pure's C60 qlc nvme and Dell's Powerstore exclusively run 208v. Honestly, economically it also makes sense on both power usage and being able to run lower amps (and thus less costly power equipment) especially when running 208v 3Phase
Sherlock Holmes
Sherlock Holmes 7 aylar önce
they might as well start their own storage provider service
Luke Hendricks
Luke Hendricks 6 aylar önce
Imagine the static pressure of those fans to push air between hard drives
Telhmaaa
Telhmaaa 6 aylar önce
Hej Linus, what is the power consumption of that giant mother x3? I always wondered how much storage uses in elektricity. thanks!
Clark Kent
Clark Kent 6 aylar önce
I wonder what the cost difference would be vs using cloud storage with a dedicated connection? There's the cost of storage and the dedicated connection, but what does this equipment cost with power and hours spent? I know AWS has a different storage option where data frequently accessed is cached locally.
Jason Snyder
Jason Snyder 7 aylar önce
The standard deal I have seen with ZFS is to do 8 drive vdevs of RAIDZ level 2. It seems to be a good break point when dealing with lots of data. I suppose 10 drives isn't too far from that. I would not recommend doing deduplication. It eats a lot of resources, really slows things down, and unless you have a whole lot of duplicate data, it doesn't really help. When you look at all of the resources deduplication eats up and what those resources cost, maybe just consider buying more drives and call it a day. For compression, zstd seems to be a pretty good deal. May still want to think about how compressible your data is and if you want to be spending so much CPU on compression. For an archive server, even if it just helps a little, may consider it.
SHUBH
SHUBH 7 aylar önce
I am happy to announce that I built my first pc exactly 1 year ago, that means I did not miss any single video of LTT from 1.8 years almost, it was a new space for me I remember what horrible parts I chose while making the first list of parts then after getting knowledge From here and other creators also i selected the best bang for the buck components. My budget was very low so it had to be good. While my first selection was like just looks and names of the brand but the when I made the second list which was around 6-7months later it was much better. All and all thanks LMG for helping me love computers
Philip Mitchell
Philip Mitchell 7 aylar önce
You need to do a silver shaft option. I'm on the list for screwdriver and would prefer silver shaft
Ewen Chan
Ewen Chan 7 aylar önce
At this point, you SHOULD be running a robotic tape library by now if you're running 3.6 PB of raw storage for archive. There's literally NO excuse for you NOT to be running a robotic tape library by now. But yes, at startup, because the system doesn't know the state of your environment nor the thermal conditions of the drives, it will run the fans at 100% (which is not unusual/uncommon) until it gets the environmental sensor data and the drive temp data and it will start ramping down the fans. The old Sun Microsystems SunFire X4200 was I think rated at something like 106 dBA for the front six fans that it had. You're getting into data center class/hyper scaler class hardware and leaving the realm of "normal" business/enterprise grade hardware.
10 Hours Channel
10 Hours Channel 6 aylar önce
At this rate you would need a whole warehouse just for the server
Jay Shank 007
Jay Shank 007 7 aylar önce
I wont get excited untill he builds a storage server, like size of a facebook server.. Till then, this is puny for me and for him.
adam prestidge
adam prestidge 7 aylar önce
Feels like these servers have been rebuilt like 6 times this year alone
Atheist7
Atheist7 7 aylar önce
[We’ve NEVER done this before…] I.... don't..... believe it.
Tony S
Tony S 7 aylar önce
😂 😂 😂 😂 😂 😂
Aurélien ETIENNE
Aurélien ETIENNE 6 aylar önce
I imagine one day you'll probably have few 42u racks full of those beasts, and that could be verry cool to work on.
MobileChaos
MobileChaos 7 aylar önce
Use a labeler and put the drive serial number on top to make double sure you are pulling the correct drive. Would be easy to pull the 2nd drive on the bottom of the row to later find out you pulled the 2nd drive from the top of the row.
Canal do Gio
Canal do Gio 6 aylar önce
16:33 it's so nice they included the THX intro on that server
Peter Batchelor
Peter Batchelor 7 aylar önce
Oooof! I feel for the bearings in that standing table! Also, goo advert for it, most cap out ar around 80-90kg!!! Although mine is rated to 120kg. LLT store suggestion, can we get a bundle for all of the t-shirts, not to save money, bust to save me having to hunt them all out (LTT store needs improved product filters FYI).
bgezal
bgezal 7 aylar önce
I'd love to see them installing a tape backup. But they never complete a storage.
Lord Carnor Jax
Lord Carnor Jax 7 aylar önce
@Administrator WSV What are you talking about? HPE, Dell all still sell LTO tape drives or libraries. What we've seen is a consolidation in the manufacturers, a number of these IT vendors just resell another OEM's drives & libraries like Lenovo and Dell do with their badge on it. IBM & HPE still have a wide range of libraries. HPE's biggest LTO library can expand to a 56,400 slot, 144 drive 2.53EB behemoth. IBM has something a bit smaller. The other consolidation is that HPE & Quantam have left the development of the drives to IBM. Those three companies control the LTO consortium.
Andreas Elf
Andreas Elf 7 aylar önce
@Administrator WSV What is used instead?
bgezal
bgezal 7 aylar önce
@Xanderplayz Yeah you jolted my memory, it was 2018 trvid.com/video/video-alxqpbSZorA.html Since then LTO-9 (18 TB) has arrived and LTO-12 (144 TB) has been teased.
Andreas Elf
Andreas Elf 7 aylar önce
Buying the second half of the new building and converting it to an automated tape drive storage. That whould be one heck of a series.
Xanderplayz
Xanderplayz 7 aylar önce
They did, but we never heard of it ever again
Ben McBeen
Ben McBeen 6 aylar önce
The connector is call AirMax. Used a lot on datacenter blade servers. treat them super gentle. They jam and break really easily. I recommend never disconnecting them.
Seikojin Sama
Seikojin Sama 7 aylar önce
Series by series, you are getting closer and closer to a MS lab.
Nicole Gardner
Nicole Gardner 6 aylar önce
As someone who's trying to get into TrueNAS, I would *love* to see a video explaining ZFS. I've been trying to wrap my head around why vdev setup is important and haven't really figured it out.
heroofnone
heroofnone 6 aylar önce
It's always a good day when we get to see Jake being SAS-sy to Linus
Neoxon
Neoxon 7 aylar önce
The only silver lining about the whole server situation at LMG is the fact that you get to build a shiny new one for content & better than ever, complete with sponsors.
NoTraceOfSense
NoTraceOfSense 7 aylar önce
@C that’s cool buddy No one asked
Jonny
Jonny 7 aylar önce
@C No
Wilson Cortes
Wilson Cortes 7 aylar önce
I wonder if silver shaft and black knurling would do/look well as a good compromise.
Stephen M
Stephen M 7 aylar önce
How about a performance test on how much memory performance (ranks, chip density (4Gb, 8Gb, 16Gb)) affects this? 8bit 2Rx8 vs 16bit 2Rx8 for example.
Matthew Burger
Matthew Burger 7 aylar önce
Regarding connector @ 8:44, I am fairly certain those are some variant of an Impact connector. Lots of companies, including TE Connectivity and Molex make them. They're used for routing high-speed differential pairs from a daughtercard to a backplane.
Drew
Drew 6 aylar önce
Oh sweeet! All the stuff I'm working on right now. Discussing a vdev type special with 45Drives to add to our Storinator, because last week we got f*cked trying to process folders with 90K files. And this Supermicro is nifty, still I'm inclined to go with Seagate Corvault, but those look like direct competitors. Got a meeting with our consultant tomorrow, to discuss planning 208V power and extra-deep racks for our new server room, because those suckers are 46" deep! No I don't work for LTT, but LTT can work for me. ;-)
Archaon88
Archaon88 5 aylar önce
Corvault isn't a JBOD. Closest equivalents to this system from Seagate would be an Exos E 4U106 or 5U84.
Z
Z 7 aylar önce
Those jbod expanders Reminds me of the old expansion connectors from pre power macs.
WizBAng
WizBAng 7 aylar önce
The intro was pure gold. Laughed so hard!
DCOLD
DCOLD 4 aylar önce
Damn, I wish I can use this for my Plex Server.
dura2k
dura2k 7 aylar önce
Why a Z2? With this much data the resilvering will need ages if one drive fails. A mirror+stripe would be much faster in daily use and in recovery… Yes, with Z2 it‘s not important which disks will fail, you‘ll always have 2 disks which can fail, but resilver is high risk… I would at least use Z3, but would try to avoid it.
dura2k
dura2k 6 aylar önce
@Mark Butler I didn’t talk about the (bad) speed, I think the most important thing here should be security and availability and this is also really bad with ZX and disks with many devices and/or high capacity because of the resilver process.
Mark Butler
Mark Butler 6 aylar önce
It's all about capacity. Since this is archival storage they don't need the performance improvement that mirroring provides and Z2/Z3 allows for a lot more usable storage.
Animaxtor
Animaxtor 7 aylar önce
I love how at their scale they could pay a company to manage their data professionally but they instead just YOLO it for the sake of making more content...
Animaxtor
Animaxtor 6 aylar önce
@PWN NATION I think you could be right. With the growth of floatplane and the lab, soon they are going to need more than a few petabytes and a logical step could be having their own branch dedicated to data management. Something like Floatplane or Creator Warehouse...
Nicolai0901
Nicolai0901 7 aylar önce
@Chiron maybe less than an Full Time Sysadmin BUT a Sysadmin would not only maintain the Server but also all other Servers, maybe even Clients and users, the Network. An Storage Server that is well setup and running does not need much maintenance (hours/week) setting it up sure that takes some time but that would be like a 1 or 2 Week project. After that you need to spend a few hours per month to make sure that everything stays up to date and no data is corrupted (redundancy is key for something like that, but as Linus stated in an older video if the data is lost its lost not great but fine they could get everything back from youtube). And the key advantage on having everything on Prem is latency
3nertia
3nertia 7 aylar önce
@Gavin Greenwalt If only the rest of us could get free hardware so we could manage our data for cheap/free too ...
roy k
roy k 7 aylar önce
tbh, 1 week worth of video from all LTT channel maybe could pay them all if it was not being used by other project
Chiron
Chiron 7 aylar önce
A petabyte at something like backblaze b2 would be around $5-6k per month. Pretty expensive, but also probably less than a full time Sysadmin... I don't think they could expect anywhere close to the current performance though even with their 10G fiber connection.
picdu
picdu 7 aylar önce
Would be interesting to know how much this monsters cost in electricity per month
Barry Whittingham
Barry Whittingham 7 aylar önce
At this point, if you don't have a scissor lift right by your server room to hold that front-loaded weight when you pull the drives, you're going to have the most EPIC episode of "Linus drops stuff" in the history of Linus dropping stuff.
Sonraki
THE AMAZING DIGITAL CIRCUS (teaser)
0:59
The Pay-To-Win Gaming PC
14:20
görünümler 1 700 000
Why our Screwdriver took 3 YEARS
29:12
görünümler 3 600 000
I Await Sony’s Cease and Desist
17:26
görünümler 4 100 000
Building the $1,000,000 Computer
27:39
görünümler 3 900 000
Theft or a good deed?
0:28
görünümler 2 692 556
Real Friendship 😍 #shorts
0:14
görünümler 3 222 936