• Hacker News
  • new|
  • comments|
  • show|
  • ask|
  • jobs|
  • saejox 48 minutes

    i wonder if we can emulate an FPGA on a rtx 3090? then test it on an AWS EC2 F2 few hours a day.

  • chalkycrimp 57 minutes

    Good chance I'm not the only one thinking this: share the code

  • codekansas 1 hours

    This is cool

    Next step is tuning your post training pipeline to optimize your model for your chosen FPGA architecture...

  • spwa4 8 minutes

    I must say I do see one application for this, that you can't really match reasonably: you can bake weights into an FPGA and then run them for 5W at a speed that will be competitive with a big Nvidia card.

    (unfortunately for a decent model it will also be price competitive with a big nvidia card)

  • cpldcpu 48 minutes

    I did something like this with Opus 4.5: https://github.com/cpldcpu/smollm.c

    It seems implementing transformers is the new "hello world" of AI assisted coding.

  • Archit3ch 15 minutes

    Now do silicon. ;)

    IshKebab 10 minutes

    Did you miss this?

    https://architectlabs.com/blog/frostbite

  • datadrivenangel 1 hours

    Does not say what type of model or size they were serving, but one of the traces mentions Maple, which is a 20b model. Still, getting ~70+ tok/s is quite good.

    risyachka 1 hours

    Fpga is software-driven, model can verify its output easily.

    Zero surprise it did it

    datadrivenangel 1 hours

    it only cost them $10,000 in Claude API usage. :)

    hmate9 1 hours

    You get that much usage in a monthly $200 subscription.

    dofm 1 hours

    And a kitten.

    dvh 48 minutes

    So who's paying the cost?

    nyc_data_geek 4 minutes

    Retail and society as ANT shares get pulled into index and wealth funds

    exe34 47 minutes

    Corporate customers

    stronglikedan 8 minutes

    Everyone else that doesn't use the entirety of the plan they pay for.

    ralph84 15 minutes

    API pricing vs. individual plan pricing is just price discrimination. They're both positive gross margin.

    surgical_fire 8 minutes

    People believe in some wild stuff.