Meta's GB{2,3}00 Cluster

(engineering.fb.com)

30 points | by stokedmartin 1 day ago

6 comments

xeubie 8 minutes ago

It seems that Meta didn't mention one aspect of their "next-generation" AI training system: their incompetent web crawler hammers websites while completely ignoring robots.txt. Meta's 57.141.0.0/24 made up about 90% of all requests to my server this past week, and it didn't stop after I blocked it. They continue to make a request every 2 seconds despite me responding with a 403 every time. Truly an engineering marvel that Meta has bestowed upon us.
lmc 2 minutes ago

Is this one of the pilot models they claim R&D tax credits for?
https://news.ycombinator.com/item?id=49921118
alberth 41 minutes ago

Actual title: ”Inside Prometheus: Meta’s Journey to a Gigawatt-Scale Supercluster”
sgvwthry 11 minutes ago

Posting this two days before earnings seems to indicate that there is going to be some bad capex news.
ma2kx 2 minutes ago

Imagine your job is just replacing millions of Dollars worth of hardware every day. I mean there must be a reason the hold 8 GPUs per rack spare.
markhahn 47 minutes ago

shell glob rather than RE? what's the world coming to!