Language

Granite 4.0 350M

IBM Granite 4.0 350M — ultra-compact for edge deployment

Apache 2.0Source verified

Specification

Model ID

granite4-350m

Family

granite

Modality

Language

Parameters

350M

Context

131,072 tokens

Quantization

Q4_K_M

Weights

209.8 MB

Minimum RAM

1 GB

Source

Weights and provenance.

Repository

ibm-granite/granite-4.0-350m-GGUF

Registry license

Apache 2.0

Source license

apache-2.0

Access

Open — weights fetch without accepting additional terms.

Serve it

# Pull the weights onto a node
tenzro model download granite4-350m

# Serve it
tenzro model serve granite4-350m

# Or query the registry entry over JSON-RPC
curl https://rpc.tenzro.xyz \
  -X POST -H "Content-Type: application/json" \
  -d '{"jsonrpc":"2.0","id":1,
       "method":"tenzro_getModel",
       "params":[{"model_id":"granite4-350m"}]}'

Same family

Granite 4.0 1B

Granite 4.0 H-Small (32B)