Paulus Schoutsen’s Post

View profile for Paulus Schoutsen, graphic

Founder Home Assistant & Nabu Casa

Soon the NVIDIA Jetson platform can power your LLMs for Home Assistant!

View profile for Dustin Franklin, graphic

Principal Engineer at NVIDIA — Jetson AI Lab

Excited to have Ollama running onboard Jetson! It's super easy to get started with, and you can download & run practically any LLM in just a couple basic commands. This came out of the Jetson AI Lab Research Group, which has seen a flurry of activity - thanks to everyone for all your contributions! 😊 Forum post with the details: https://lnkd.in/gcUXhc3a The next community meeting is next week, and there has been lots of progress on Home Assistant and Piper TTS to discuss too! https://lnkd.in/giGHBebQ

  • No alternative text description for this image
Anthony Agresta

Senior Software Engineer, Platform/Infrastructure

1d

It's 16GB. It can do llama2 fast or llama3 slowly. I made the computer from Wargames as a chatbot and I'm gonna wire it up to my telnet BBS.

  • No alternative text description for this image
Ken Smith

Applied AI Engineer, HeyOrson

2w

Ollama is awesome. Should also be able to run the 8b version. How much GPU RAM does the new Nano max out at?

Like
Reply
Anthony Agresta

Senior Software Engineer, Platform/Infrastructure

1mo

Oh, no way. I JUST got an Orin NX module for my cluster, this might be really fun to play with.

See more comments

To view or add a comment, sign in

Explore topics