DeepSeek Elastic Compute (DSec)

(arxiv.org)

76 points | by shenli3514 3 hours ago

3 comments

  • vblanco 1 hour ago
    380.000 concurrent sandboxes on 160 Epyc based server nodes. Crazy stuff
  • doc_ick 1 hour ago
    Will admit that I haven’t read it yet, just saw the crazy number of authors and think this may compete for one of the papers with the most authors.
    • justinnk 32 minutes ago
      This one [0] about the Higgs boson is hard to beat. Pages 25-32 are just full of around 5150 „authors“, pages 33-37 are their affilliations.

      [0] https://arxiv.org/abs/1207.7214

      • tempay 8 minutes ago
        Even without that particularly special case, high-energy physics collaborations have long since broken the idea of authors. There are now many collaborations with hundreds of authors publishing regularly and quite a few that are into the thousands.
    • mendylanda 22 minutes ago
      how do you even keep up with the amount of research coming out these days
  • swingboy 1 hour ago
    Is there a lab more innovative than DeepSeek? Imagine if they had the same compute resources that Anthropic and OpenAI have.
    • ProphetOfParado 1 hour ago
      Food for thought: Constraints are the source of creativity.
      • conception 1 hour ago
        Yeah if they had the resources of an OpenAI or anthropic they’d be OpenAI or Anthropic. Scrappy underdogs have to be nimble and innovative.
        • mirekrusin 1 hour ago
          They are as “underdog” as Linux is to Windows.
      • rozim 1 hour ago
        Possibly relevant: 突破技术壁垒, "break the technical barricade" -> overcome an obstacle through innovation (in this case, sub SOTA GPUs at least).

        Native Chinese speakers to confirm....

        • michaellee8 1 hour ago
          your translation is correct, I would say Chinese labs may be able to figure out the current capability of latest frontier models in 3-6 months, but then Anthropic and OpenAI may have already been ASI in that time already. China's main problem is still lack of (good) chips, and that is a hardware issue that is unlikely to be solved for a while. and more effort for efficiency means less effort for actual capability improvements. we have already seen what anthropic can do if they focus on efficiency with opus 5.5
    • impulser_ 1 hour ago
      Short term they might have less compute, but long term they will most definitely have more compute. They don't have to worry about energy, they don't have to worry about people blocking them building data centers the only thing stopping them is there no Chinese manufacturer that can produce a chip as good as Nvidia but I would bet that solved in a year or so.
    • SmartestUnknown 1 hour ago
      Just because other companies don't write papers about what they do doesn't mean they aren't innovative...
      • doc_ick 1 hour ago
        Sure, but we’ll never know what they do or if it is innovate because we won’t know what they do.
    • ijidak 1 hour ago
      "Necessity is the mother of invention."

      Not sure they'd be the same without the constraints.