the real open AI

oio news #31

Hi friend! Welcome to a fresh new issue of oio newsā€”your non-spammy, gif-heavy, link-packed newsletter from the depths of the oioverse.

Today, weā€™re launching something. Itā€™s not a big thing; in fact, itā€™s a very small oneā€”a tiny intelligence. Remember Roby? Our AI creative director, born in our Discord server, once ran its own Instagram account and even made it into Wallpaper* magazineā€”way before the AI hype. Roby was a little outdated, and while we never upgraded it to a mainstream cloud AI model, we always liked its primitive intelligence.

That was until recently. After playing around with local AI toolsā€”Ollama, LMStudio, llamafile, open-webui (so many of them!)ā€”we realized that open-source AI models are making massive leaps forward. So, we decided it was time for Roby to step up.

Over the past few weeks, we built our own local AI machineā€”a Mac Miniā€”to power its artificial brain. Now, Roby can think, talk, write, see, generate images, and even track its own energy consumptionā€”all without ever leaving our studio. Thatā€™s rightā€”no cloud services, no subscriptions. Everything runs locally on a computer under our desk. Roby came home!

Throughout the process, we vibe-coded our own tools (as we often do) and learned so much about running a self-hosted AI setup. It was too good to keep to ourselves, so we decided to share part of our journey.

Stay tuned! Over the next few months, weā€™ll be rolling out the tools we createdā€”for anyone to use, for free.

A new family

Roby and its agents friends, all running under our desk

Roby got a new haircut. Because, you know, you canā€™t upgrade your tech stack and keep the same old look. So, weā€™re also releasing these new cute fellas into the world!

With the help of our friend Matheus, we designed a 3D graphics system that can support an ever-growing family of AI agentsā€”starting with the new Roby. So donā€™t be surprised if you see more of these 3D creatures popping up across our platforms.

roby is always ONLINE! try it by clicking on this image

šŸ«” Goodbye old friend

Weā€™re a nostalgic bunch, so itā€™s with a bit of sadness that we say goodbye to old Robyā€™s appearanceā€”the one that has accompanied us on the oio journey since the very beginning. Originally designed by our very first design internā€”Elliott. We miss you Elliott. Anyway, goodbye old Roby, weā€™ll miss you too.

šŸ„¹

Small, domestic AI

A Mac Mini under our desk powers all our AI

A few months ago, we started experimenting with local AI models, using Ollama to test them out. Theyā€™ve been particularly useful in some of the workshops Iā€™ve been running lately (more on that below šŸ‘€). Many students donā€™t have paid accounts for cloud-based AI models, and beyond that, I strongly believe that we shouldnā€™t rely on private companies for essential educational tools. The more open we can teach, the better. Let me write it again.

ā

The more open we can teach, the better.

Ideally, schools should have their own open AI infrastructure for students. Thatā€™s something weā€™re exploring with MAInD, an Interaction Design Masterā€™s program in Switzerland, where we teach every year. More details coming soon!

After these initial experiments, we realized we needed a dedicated machineā€”something that could always stay on. Luckily, we had an M2 Mac Mini lying around, so we put it to work. Not the best machine for AI, I know, but itā€™s a start.

For now, this is it: weā€™ve built an AI stack from scratch that can replace most cloud-based large language models. Weā€™re using Llama 3.2 for most tasks and experimenting with DeepSeek R1 for deeper thinking. Weā€™ve also built an image generator using Flux, which runs locally on the Mac Mini.

Check out this arena board we started called ā€œšŸ” domestic intelligencesā€, to follow our progress.

All the AI models are saved locally on the MacMiniā€”it can chat, think, generate images, and even track its own energy consumption. All without sending anything to the cloud, or paying any kind of subscriptions. It all runs there under your desk.

Energy consumption

this is a picture

The big conversation around machine learning models often centers on energy consumption. Weā€™ve heard from many people who are on the fence about using AI, worried about contributing to the high energy demands typically associated with these models. Weā€™ve been wondering the same thingā€”how much energy do these models actually use? So, we ran a little experiment: we benchmarked the energy consumption of image generationā€”one of the most power-hungry AI tasksā€”against something familiar: brewing a cup of espresso on a home machine. ā˜•

After each generation, Roby also notes the actual energy consumption that it took to generate

Wait, how do you even benchmark the energy used by a cup of espresso? Wellā€¦ we didnā€™t. We asked Roby, and it estimated roughly 6ā€“12Wh for a cup brewed on an average domestic espresso machine, which seems wild.

But when we compared this with energy usage estimates from various AI models, the results were wildly inconsistent. For now, weā€™re rolling with the lowest estimate we foundā€”10.5Wh from Claudeā€”but weā€™re not stopping there. Weā€™re committed to running real tests using a Wattmeter šŸ¤“. Watch this space!

Why?

y tho

Well, because thatā€™s what we do here at oio. Weā€™re on a mission to make technology more human, less boring, and truly accessible to the many.

We always hear about the latest 100-billion-parameter models being released, and itā€™s easy to feel detachedā€”to think that AI requires ultra-giga power-hungry computers in the cloud or a $200 OpenAI subscription just to use. But thatā€™s not the case! Local AI is here, and our personal computers are already getting pretty good at running these models. And if not today, then in one, three, or five years, they definitely will be. So weā€™re doing this to prove that an alternative isnā€™t just possibleā€”itā€™s already within reach.

ā

If you have a modern laptop, then you can run AI models locally, without writing a single line of code.

The best outcome for this experiment? For it to be shared, broken, taken apart, and reimagined. So come join us down this rabbit hole.

I think Martaā€™s words capture this feeling better than I ever could:

I'm really excited about this update not only because technically-wise it's a huge improvement under many aspects, but also because we're building something that people will be able to use in their homes. Roby's code will be in fact open-sourced so that anyone can try it and customise it. I think it's a great way to make AI accessible to anyone since it doesn't require any paid subscription to external services and it can run on a personal computer. I hope Roby will have a lot of new friends!

Marta Fioravanti ā€” creative technologist @ oio

Free as in free guide!

Starting in April, weā€™ll be slowly releasing guides and tutorials on how to get started with your own local AI. From GitHub to YouTube, all the way to lives on our Discord, so make sure to follow!

šŸ« Teaching season wrap up

Itā€™s been a hectic season on the teaching front!

im

We kicked things off in December with Invisible Frictions at CIIDā€”The Copenhagen Institute of Interaction Design (now in Bergamoā€¦ should it be renamed BIID? šŸ¤”). There, our lead designer BjĆørn Karmann and I led a course on designing and prototyping new kinds of LLM-powered interactionsā€”all running locally! Check out the video recap here.

Then, we headed to Switzerland, where I ran two workshopsā€”one at MAInD Mendrisio and another at HEAD GenĆØve.

At MAInD, we ran Things That Think, a workshop co-led with the amazing Marta Fioravanti, oioā€™s creative technologist. We worked with Interaction Design Masterā€™s students to design and prototype objects and experiences that could ā€œthinkā€ā€”kind of like Roby, but in physical form instead of Discord.

Lastly, at HEAD GenĆØve, I helped Media Design Masterā€™s students develop ideas for installations inside Plaza Cinema in Geneva. Theyā€™ll be working on these for a while, so follow their Insta for the latest updates! šŸŽ„āœØ

šŸŽ Next stopā€”oio school!

love from HEAD genĆØve

šŸ—£ļø Founders corner

Your favourite pair of yappers, Simone and I, are back for another round:

šŸ“¦ Thingscon!

yapping

oioā€™s co-founder Simone Rebaudengo did a presentation at Thingscon, last year, and itā€™s finally online on YouTube! Watch it here!

šŸ§  Beautiful Minds

more yapping

The other half of the oio founders universe, Matteo Loglio, was interviewed by newspaper Repubblica, in the Italian Tech section ā€œBeautiful Mindsā€. Read it here!

Your monthly supply of fine goods, carefully handpicked from our Discord community (missing out? Join nowšŸŖ½)

šŸ“ pong in browser tabs (by nolan royalty)
šŸ˜— emoji encoder (website)
šŸ…°ļø Wordle, but only vowels (playdate)
šŸŽ® Gameboy camera (site)
šŸƒ thinking with moss (site)
šŸŒ nomic altas (site)
āš›ļø quantum computing is here? (youtube)
šŸ¶ sacchan the fat dog (youtube)
šŸ¤– agents in convo (x.com)
šŸ‘¾ new ways of vibe coding (youtube.com)
šŸ‘™ modern beachwear (perimeterbooks.com)
šŸŽ§ music not from your algorithm (site)
šŸ§¢ the rap board (therapboard.com)
šŸŽ›ļø grove machine (tahti.studio)
šŸ§” guess my accent (boldvoice.com)

šŸ“ˆ Monthly stonks

šŸŒ wwwdigital upcycling
šŸ•¹ game: longvinter
šŸ“ arenagroceries
šŸ“š wikisoviet stamps
šŸ”§ tool: decker

āœļø words by matlo & normz

šŸŠ šŸ’£ BOMBARDINO CROCODILO