, News summary

IBM’s Granite Switch 4.1 puts chat, decisions and speech in one model

IBM’s new Granite Switch models combine chat, decision-making, safety checks and speech-to-text in one model served from a single endpoint.

At a glance

model sizes
8B / 30B
endpoint for chat, decisions and speech
1
What’s new
Small Activated LoRA adapters add decision and safety skills while reusing the base model’s cache, so switching tasks is quick and needs little extra GPU memory.
Who it affects
Companies running AI in production that currently chain several separate models together.

The details

IBM says its Guardian adapter beats several rival decision models on average at safety-related tasks, and the bundled speech model is the fastest on the OpenASR leaderboard. Developers can also build their own Switch models by mixing adapters from IBM’s Granite Libraries, and IBM plans an SDK for training new ones.

Why it matters

Many AI apps chain a chat model, a classifier and a transcription model, each on its own hardware. Packing them into one model can cut cost and delay for companies running AI in production. It also strengthens the case for small, specialised adapters alongside ever-larger general models.

Original source

Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint

Hugging Face · huggingface.co

About this summary. Written by the nplusoneai newsroom from the original report. Full reporting is at the source. Spotted a mistake? Tell us.