Ratty – A terminal emulator with inline 3D graphics

(ratty-term.org)

139 points | by orhunp_ 2 hours ago

25 comments

  • pjmlp 46 minutes ago
    UNIX still trying to catch up with Xerox workstations in the REPL experience, or general Lisp machines for that matter.

    Inline graphics from 1981,

    https://youtu.be/o4-YnLpLgtk?t=376

    • pocksuppet 44 minutes ago
      Or TempleOS.
      • Onavo 40 minutes ago
        That was a work of art. Also Oberon.
  • CTDOCodebases 3 minutes ago
    "Don't worry, all of these dependencies are worth it."

    That had me in stitches.

  • noelwelsh 25 minutes ago
    I like this. No reason the terminal should only support text. Data science notebooks show one way the terminal can evolve. Lots of interesting stuff happening in this space, with Kitty probably being the most aggressive innovator here [1]. I'm not sure there is an overall vision, though.

    [1]: https://sw.kovidgoyal.net/kitty/protocol-extensions/

    • the_other 4 minutes ago
      Mix this 3d graphics, with data science notebooks, with local LLMs, and perhaps an integrated coding harness, with visibility over your personal data and you’d have something absurdly good.

      This might overtake “a haiku+macOS mashup” as my idealised computing future.

    • alias_neo 16 minutes ago
      I wonder if something like this could work for thumbnails in the terminal; I prefer to browse my filesystem from a terminal rather than the point and click file manager typically, and it would be really useful if I could have a grid-style `ls` with terminal based renders of the 3d models (thinking STL/STEP, 3D printing) in that directory. Bonus points if I could preview/rotate the model to inspect it.
    • bcjdjsndon 18 minutes ago
      Terry A Davis already did this. It was as crazy then as it is now
      • Wololooo 8 minutes ago
        Obligatory Temple OS unhinged video.

        https://www.youtube.com/watch?v=o48KzPa42_o

        Joking apart, the whole thing was both an exercise in madness and genius. Sometimes I wonder what he would have done if he had not gone crazy. We will never know...

  • sigseg1v 1 hour ago
    Seems... really good?!

    Questions:

    - rendering capabilities of this seem like it should also be able to handle 2d well, or am I mistaken? every solution I see for getting high quality 2d images or rasterization in terminal is all pretty bad. Could this do better than other solutions or is there a fundamental limit being hit somewhere?

    - What happens with ssh given that this is gpu accelerated?

    • berkes 37 minutes ago
      There are quite a few GPU powered terminal emulators around already.

      Is that what you're looking for?

  • amelius 57 minutes ago
    Terminal is slowly becoming a full featured web browser.
    • iugtmkbdfil834 55 minutes ago
      Always has been meme incoming. Also, more seriously, the purpose of a tool is to do a job. The question becomes whether this tool can be made useful. I.. honestly don't know, but I will be finding out soon:D
    • shevy-java 47 minutes ago
      And rightfully so! \o/
  • arkwin 6 minutes ago
    We are one step closer to the terminal in the movie Hackers, and I am all for it.
  • whywhywhywhy 2 minutes ago
    I was gonna comment here "real TempleOS vibes" then the TempleOS logo appeared a moment later in the demo video.
  • iugtmkbdfil834 1 hour ago
    Rip Terry. May you never be forgotten.

    edit: But your spirit lives on ( based on the project:D )

  • pelagicAustral 1 hour ago
    Can I really render a 3D rat on my terminal? If I can then I'm sold.
    • sevenzero 1 hour ago
      This is exactly what I thought as well.
  • silon42 58 minutes ago
    IMO, next crazy step is for terminal to just have wayland or X11 protocol ? (/s or not?)
  • darkwater 23 minutes ago
    What would happen when you use `cat` in Ratty then?
  • mohamedkoubaa 35 minutes ago
    Emojis in a terminal are a step too far for me. This is just... Indulgent.
  • basilikum 1 hour ago
    This looks a lot like it'd qualify for a ShowHN. Add "ShowHN: " to the beginning of the title and it should show up in /show
  • voidUpdate 1 hour ago
    I was going to comment how it reminded me of TempleOS and the author should look into that, but the accompanying blog post explains how it was inspired by it https://blog.orhun.dev/introducing-ratty/
    • iwontberude 1 hour ago
      [flagged]
      • hailruda 1 hour ago
        User name doesn’t checkout.

        Any technical reason for such a strong opinion?

        • iwontberude 1 hour ago
          He constantly used the N word to describe black people and always was warning people about how evil black people were. I’m not making this up, go watch his streams.
          • iugtmkbdfil834 1 hour ago
            Hold up.. is that your definition of a technical reason?
            • iwontberude 1 hour ago
              Yes and I can appreciate why you don’t see it as technical, but software should be made to help users. I was brought up the ACM way.
      • AntiUSAbah 1 hour ago
        It looks like he has schizophrenia which I would argue is a mental illness, a strong one.

        Why are you so invested in TempleOS?

        • iwontberude 1 hour ago
          Mental illness is no excuse for vile white Christian nationalism and hate against blacks. Miss me with that ignorance.

          It’s clear how hateful he is from just watching his streams. It’s not a tick or a symptom of a clinical issue, it’s a deep seated belief that was only exposed to us because of his schizophrenia.

          Yes I have empathy for him and I also recognize that he is a menace and probably is better unknown. We are spoiled for choice anyways.

          • AntiUSAbah 1 hour ago
            So just to be clear, a human being can't think properly / straight anymore, has issues forming a coherent worldview, has regularly crazy maniac phases were he would drive like 100 miles, dismantle his car, throw away his keys but you do not accept any of this as a reasonable excuse that that particular human is not able to break out or even manifests stereotypical thoughts?

            The mental base mode you are born, is a community of christians, parents forming your mind etc. and you have to break out of this, formulate your own independet worldview. A lot of people can't do that today. All religios people in fact.

            Plenty of woman can't break out of absuve relationships, familys protecting someone inside the family even if they are rapists due to "family is family; what would others think of us" etc. and thats were you draw the line for that Human being?

            • bonsai_spool 1 hour ago
              > Plenty of woman can't break out of absuve relationships, familys protecting someone inside the family even if they are rapists due to "family is family; what would others think of us" etc. and thats were you draw the line for that Human being?

              I think you're being fair overall, but I would also say that OP in this thread reply is highlighting something worthwhile. If Terry were a misogynist, I don't think this thread would have taken as long to recall his abnormal behavior. But that's just, like, my opinion.

      • rvz 1 hour ago
        It is just software. TempleOS and this project just looks cool.
  • 2ndorderthought 1 hour ago
    I actually see some use cases for this. It's one of those should be nonsense projects that somehow isn't.
    • panzi 44 minutes ago
      What use cases do you see?
      • drob518 31 minutes ago
        Yea, gotta be honest here; I’m struggling to see many use cases here other than 3d graphs. I really don’t need a spinning 3d rat cursor.
      • 2ndorderthought 30 minutes ago
        Checking 3d models in a directory inside my terminal to see what's what without opening an application and clicking 100 times.
      • avaer 31 minutes ago
        Game development.
  • neomantra 1 hour ago
    Really fun project! Dude, I spent the last week implementing Kitty Graphics and Clipboard protocols in ghostty-web in the Canvas render.

    Then I added WebGL and WebGPU renderers [1], including support for Kitty.

    Then I see this this project on a Monday morning... so now I have to implement Ratty Graphics Protocol?!?! [2].

    ETA: I looked into this; Ghostty would need patched to support Ratty since Ghostty-Web now defers APC handling there. It would also require pulling in a 3D engine like three.js or otherwise implementing file parsing, lighting, etc. Finally, since local filenames are part of the protocol, a browser would need some file resolver helper, either to get the data over the APC channel or via a URL.

    [1] https://github.com/NimbleMarkets/ghostty-web/tree/nm-webgpu

    [2] https://github.com/orhun/ratty/blob/main/protocols/graphics....

  • nickcageinacage 36 minutes ago
    so cool. well done
  • shevy-java 47 minutes ago
    This is a great idea. I always wanted KDE konsole to e. g. show images inlined as is. This is possible via magick six:-, but I wanted this to be natively. I want the terminal to be able to work with any data and display it in any way. No need to simulate the 1980s era anymore (except for backwards/legacy support). So great idea here really.
    • berkes 35 minutes ago
      Kitty and several other terminal emulators, have built in graphics display already. IIRC, this is called the kitty protocol, but I might be mistaken.
    • anthk 21 minutes ago
      I did that with Sixels, no Rust needed, no 3D crap, no ad-hoc addons, just old vt340 support in XTerm.

      That's how I read images under a remote pubnix with tut using a Mastodon account over plain SSH.

      Chafa and XTerm. It works.

  • iugtmkbdfil834 1 hour ago
    Dude. Congrats. You actually made a compelling argument to put rust on my machine:P
  • Lucasoato 1 hour ago
    Imagine this with VR dev environments!
  • infoinlet 54 minutes ago
    [flagged]
  • openclawclub 1 hour ago
    [dead]
  • tester121 49 minutes ago
    [dead]
  • soupspaces 51 minutes ago
    [dead]