Software for the new era of computers.

A new era of computers

A personal computer is no longer only a place to run programs. Its graphics card and memory can now run and train machine learning models, which changes what software can do for the person using it, and where their data has to go.

MLSoma is built for that. Its engine is written from scratch, talks to your graphics card through the driver you already have, and keeps your files, prompts and models on your computer. It only goes online for what needs it, such as downloading a model or an update.

Compatibility

MLSoma runs on Windows, macOS and Linux. It runs local AI models on NVIDIA graphics cards through CUDA, on AMD and Intel graphics cards through OpenCL, and on Apple silicon Macs through Metal, using the display driver that's already installed: there's no CUDA toolkit or vendor SDK to set up. Without a graphics card, models run on the processor.

A model larger than your graphics card's memory still runs: MLSoma keeps what fits on the card and streams the rest from system memory.

Compatibility is continuous work. As new graphics cards, processors and operating system versions arrive, we keep adding support for them, starting with what people ask for most. If MLSoma doesn't run well on your hardware, tell us.

Why not open source?

Besides questioning what open source means nowadays, keeping MLSoma closed makes a lot of sense to us today.

The words cover very different things now: model weights called open that come with licenses limiting how they can be used, and projects maintained for free while they run other companies' businesses. "Open" alone no longer says much about what you get.

A closed engine lets one team answer for all of it, from the code that runs on your graphics card to the window you click in, and keep working on it full time. MLSoma stays free to download and use for individuals and small companies; Premium, and the ads on this website, pay for the rest.

Do we use AI?

When it makes sense, yes. We build software for AI, and we use AI tools where they do the job well, such as writing and checking code, or translating this website. People decide what ships, and test it first.

Get in touch

Questions, ideas, or something that doesn't work? Write to us at [email protected].