Our Smallest, Most Efficient Model: Muse Ember

(research.meta.ai)

28 points | by dvaplima 47 minutes ago

4 comments

  • simonw 18 minutes ago
    Six effort levels (minimal, low, medium, high, xhigh, max), so here are six pelicans (actually five, "high" didn't return a complete SVG):

    https://tools.simonwillison.net/markdown-svg-renderer?url=ht...

    There's usually a reasonably strong correlation between thinking level and visual quality of the pelican. This is the first time I've seen that correlation appear to break - more reasoning tokens doesn't seem to produce an obviously better SVG.

    • imimayj1337 5 minutes ago
      It does pretty insane to me that only on max setting (and after waiting 27 seconds) did you actually manage to receive an SVG where the pelican's legs are straddling the bike correctly.
    • meric_ 6 minutes ago
      Wow, minimal seems to be the best here interestingly. Only 10 reasoning tokens so basically none?
    • permalac 5 minutes ago
      Is there a problem if I like the minimal more than the others?
    • sjacob 6 minutes ago
      Incredible. How do you get these out so fast?
    • AmazingTurtle 12 minutes ago
      [dead]
  • open-paren 6 minutes ago
    I believe this is what the “crouton alpha” stealth model was

    https://openrouter.ai/stealth/crouton-alpha

  • Starlevel004 6 minutes ago
    Luna 6 is getting a bit long in the teeth now. It's two full months old, but it was only a slight step above Luna 5.6, which was already four months old (Imagine saying this about anything else). So I'm not too surprised that a newer small model is beating it handily. I've been hoping for Luna 6.1/2 as the next model release for a few days now.
  • caaqil 4 minutes ago
    I'm always a bit surprised to see Meta talking about models. They have become (almost*) entirely irrelevant to the LLM race, which is weird because their AI lab used to be decent before LLM was cool.

    What happened to zuck? Was the metaverse this destructive?

    (*) Feeling charitable today

    • esafak 2 minutes ago
      They have started to catch up; the Spark series is good.