RISC-V Datacenter

Open ISA Supercomputing: SG2044 Reaches 294 GFLOP/s at 64 Cores, Beats Xeon on LLM Decode

📅 2026-10-27 ⏱ 10 min read 🔗 Source: arXiv:2610.32632v1 (submitted 23 Oct 2026, University of Bologna / ETH Zurich)

RISC-V's HPC story has suffered from a measurement problem: every paper used a different board, a different software stack and rarely reported energy at all, so "RISC-V is 5x slower" and "RISC-V is competitive" could both be published about the same year. A preprint submitted to Future Generation Computer Systems on 23 October 2026 fixes the methodology first and the conclusion second — one software stack, one methodology, nine benchmarks, three architectures, and wall power measured properly.

Honesty note. This is arXiv:2610.32632v1, a preprint submitted 23 October 2026 and not yet peer reviewed. Numbers below are quoted exactly as the authors report them; nothing is extrapolated, and where a figure comes from a third-party consumer benchmark it is labelled as such. The headline is not "RISC-V wins" — it is "RISC-V is now measurable, and the gap is narrower than the marketing on either side suggests."

What Was Measured, and Against What

Twelve authors from the University of Bologna and ETH Zurich (Emanuele Venieri, Giacomo Madella, Gabriele Ceccolini, Simone Manoni, Federico Ficarelli, Filippo Barbari, Jenny Lynn Almerol, Elisabetta Boella, Nitin Shukla, Simone Bnà, Luca Benini, Andrea Bartolini) characterise the Sophgo SG2044 — the 64-core RISC-V server SoC — and compare it with two incumbent platforms.

PlatformRole in the study
Sophgo SG2044The RISC-V subject: 64 cores, the first mass-available multi-core RISC-V server part
NVIDIA Grace CPU SuperchipArm reference, server-class
Intel Xeon Platinum 8480+x86 reference, Sapphire Rapids generation

Four HPC benchmarks and four real applications, all built from a common stack:

ClassWorkloadsWhat it stresses
BenchmarksSTREAM, HPL, HPL-MxP, HPCGMemory bandwidth, FP64 dense and mixed-precision linear algebra, sparse/conjugate-gradient behaviour
ApplicationsiPIC3D, PLUTO, OpenFOAM, llama.cppParticle-in-cell plasma, astrophysical MHD, CFD, LLM inference

One methodological detail is worth flagging because it is the difference between a fair test and a benchmark-shaped one: the authors built a version of HPL-MxP linked against OpenBLAS for this work and released it as open source. Without OpenBLAS the RISC-V run would have had no competitive BLAS to sit on, and the mixed-precision number would have been meaningless.

The Numbers

MetricSG2044 resultSource
FP64, per core8.02 GFLOP/sPaper, measured
Memory bandwidth, per core7.8 GB/sPaper, measured
FP64, 64 cores294 GFLOP/sPaper, measured
Memory bandwidth, 64 cores107 GB/sPaper, measured
ScalingNear-linear to 16 cores; memory-bandwidth saturation beyondPaper, with L2-cache-aware process placement
Absolute performance vs Grace / Xeon 8480+8–15× lowerPaper, measured
LLM decode, 64 coresHighest relative scaling and energy efficiency of the three platforms; higher throughput than IntelPaper, measured

Two of those lines deserve to be read together, because they look contradictory and are not. 294 GFLOP/s across 64 cores is roughly 4.6 GFLOP/s per core at scale against 8.02 GFLOP/s measured for a single core: 57% parallel efficiency by FP64 peak. That is not a bad number for a first-generation 64-core open-ISA part, and it is consistent with the paper's own diagnosis — scaling stops being near-linear after 16 cores because 107 GB/s of shared memory bandwidth saturates, not because the cores are slow. Bandwidth is the wall, not compute.

Monte Cimone: Three RISC-V Generations, One Line

The most useful part of the paper is not the cross-architecture comparison at all — it is the within-RISC-V comparison across the Monte Cimone (MC) cluster generations, an Italian RISC-V HPC testbed. Because these are successive RISC-V systems measured with the same stack, the deltas are pure generational progress, unpolluted by ISA differences.

GenerationAgainstImprovement
MCv3 (SG2044-based)MCv22× single-core performance; 2× peak memory bandwidth
MCv3 (SG2044-based)MCv1≈100× memory bandwidth; 158× node-level FP64 performance; 10× energy efficiency

The MCv1→MCv3 numbers are not a chip refresh, they are a category change — two orders of magnitude in bandwidth and 158× in node FP64 inside one project's lifetime. Anyone planning a three-to-five year RISC-V roadmap should treat those as the observed slope rather than assuming the current part is what they will be competing against.

Where RISC-V Actually Wins Today: LLM Decode

The result that will get quoted is this one: on llama.cpp LLM decode, 64-core SG2044 execution delivered the highest relative scaling and the highest energy efficiency of the three platforms, and exceeded the Intel Xeon 8480+ in throughput.

It is worth being precise about why that is plausible rather than surprising. Autoregressive decode at batch 1 is memory-bound: every token requires streaming the weights, so throughput tracks memory bandwidth and capacity, not FP64 peak or vector width. The SG2044's weakness — narrow vector resources on an older node — is exactly the thing decode does not care about, while its 64 general-purpose cores and aggregate bandwidth are the things it does. That is also exactly the workload profile the authors of a separate study would call a new rather than existing market: decode and agent-style serving are loads without twenty years of x86-tuned legacy software behind them.

Read this correctly. "Beats Intel on LLM decode" does not mean the SG2044 is a better Xeon. It means that for one memory-bound workload, on this software stack, at 64 cores, the open-ISA part is ahead on throughput and energy per token while being 8–15× behind on FP64 absolute performance. Both statements are true at once, and product decisions should be made on the workload you actually run.

The Three Things the Paper Says Are Still Missing

The authors are explicit about attribution: the 8–15× absolute gap reflects narrower vector resources and a less advanced technology node — the first is an ISA-implementation choice, the second is a fab choice. Neither is a property of RISC-V itself, and both are addressable within the same architecture. Their conclusion is correspondingly measured: RISC-V processors are closing the gap, not that they have closed it.

BottleneckEvidenceWhat would move it
Vector width and implementation qualityExplicitly named as the cause of the per-core deficitWider VLEN, better RVV scheduling; the same gap the kernel community is chasing with auto-vectorisation work
Process nodeStated as the second cause of the absolute gapVendor decision, not an ISA decision — but it sets the ceiling no software can lift
Memory bandwidth saturationNear-linear scaling stops at 16 cores; 107 GB/s at 64 coresMore bandwidth per socket, or bandwidth-aware placement; the paper's L2-aware placement already recovers most of the loss

Builder Takeaways

中文摘要

2026 年 10 月 23 日,一篇投递给 Future Generation Computer Systems 的预印本(arXiv:2610.32632v1)用同一套软件栈与方法学,把等国 SG2044(64 核 RISC-Vﺹ与 NVIDIA Grace、Intel Xeon Platinum 8480+ 放在同一把尺子上。

实测数据(论文原值):单核 FP64 8.02 GFLOP/s、单核内存带宽 7.8 GB/s;64 核 FP64 294 GFLOP/s、带宽 107 GB/s。依赖 L2 感知的进程数据布置,扩展在 16 核以内接近线性,之后被共享带宽饱和卡住。相对 Arm 与 x86 的绝对性能仍差 8–15×。

亮点:在 llama.cpp 的 LLM decode 上,64 核 SG2044 的相对扩展效率与能效在三平台中最高,并且吞吐量超过 Intel Xeon 8480+。原因不难理解:batch=1 的自回归解码是内存带宽型负载,不吃向量宽度。

代际进步(Monte Cimone 集群):MCv3 相对 MCv1,带宽约 100×、节点级 FP64 158×、能效 10×,单核和带宽相对 MCv2 各翻 2×。

罢论与边界:论文自己归因为“向量资源较窄”与“工艺节点较旧”,并明确结论是“正在缩小差距”而非“已经追平”。此文为预印本,尚未同行评审。

对开发者的意义:设计 64 核 RISC-V 时,带宽预算比 TOPS 更关键;先选负载再选 ISA,因为同一颗芯片可以同时“FP64 落后 10 倍”和“decode 超越 Xeon”。

Краткое содержание (RU)

Препринт arXiv:2610.32632v1 от 23 октября 2026 (Болоньский университет / ETH Цюрих) сравнивает Sophgo SG2044 (64 ядра RISC-V) с NVIDIA Grace и Intel Xeon Platinum 8480+ на едином программном стеке.

Цифры: 8,02 GFLOP/s FP64 и 7,8 GB/s на ядро, 294 GFLOP/s и 107 GB/s на 64 ядрах; почти линейное масштабирование до 16 ядер, затем насыщение полосы памяти. Абсолютное отставание от Arm и x86 — 8–15×. На LLM-decode (llama.cpp) 64 ядра дают лучшую энергоэффективность и превосходят Intel по пропускной способности. По колению Monte Cimone: MCv3 против MCv1 — ≈100× по полосе, 158× по FP64 на узел, 10× по энергоэффективности. Это препринт, не прошедший рецензирование.

Resumen (ES)

El prepint arXiv:2610.32632v1, enviado el 23 de octubre de 2026 (Universidad de Bolonia / ETH Zúrich), compara el Sophgo SG2044 de 64 núcleos RISC-V con NVIDIA Grace y un Intel Xeon Platinum 8480+ usando una única pila de software y metodología.

Cifras: 8,02 GFLOP/s FP64 y 7,8 GB/s por núcleo; 294 GFLOP/s y 107 GB/s con 64 núcleos; escalado casi lineal hasta 16 núcleos y saturación de ancho de banda después. El rendimiento absoluto sigue siendo 8–15× inferior al de Arm y x86. En decodificación LLM (llama.cpp) con 64 núcleos obtiene la mejor eficiencia energética y supera en throughput al Intel. En la comparación generacional Monte Cimone, MCv3 frente a MCv1 supone ≈100× de ancho de banda, 158× de FP64 por nodo y 10× de eficiencia energética. Es un prepint, sin revisión por pares.

Résumé (FR)

La prépublication arXiv:2610.32632v1, soumise le 23 octobre 2026 (université de Bologne / ETH Zurich), compare le Sophgo SG2044 à 64 cœurs RISC-V à NVIDIA Grace et à un Intel Xeon Platinum 8480+, avec une pile logicielle et une méthodologie uniques.

Chiffres : 8,02 GFLOP/s FP64 et 7,8 GB/s par cœur ; 294 GFLOP/s et 107 GB/s à 64 cœurs ; mise à l'échelle quasi linéaire jusqu'à 16 cœurs, puis saturation de la bande passante. Les performances absolues restent 8 à 15 fois inférieures à Arm et x86. En décodage LLM (llama.cpp) à 64 cœurs, la plateforme obtient la meilleure efficacité énergétique et dépasse l'Intel en débit. Sur la comparaison générationnelle Monte Cimone, MCv3 face à MCv1 représente ≈100× de bande passante, 158× de FP64 par nœud et 10× d'efficacité énergétique. Prépublication non évaluée par les pairs.

Kurzfassung (DE)

Das Preprint arXiv:2610.32632v1 (eingereicht am 23. Oktober 2026, Universität Bologna / ETH Zürich) vergleicht den Sophgo SG2044 mit 64 RISC-V-Kernen gegenüber NVIDIA Grace und einem Intel Xeon Platinum 8480+ — mit identischem Software-Stack und identischer Methodik.

Zahlen: 8,02 GFLOP/s FP64 und 7,8 GB/s pro Kern; 294 GFLOP/s und 107 GB/s bei 64 Kernen; nahezu lineare Skalierung bis 16 Kerne, danach Speicherbandbreitensättigung. Die absolute Leistung liegt weiterhin 8–15× unter Arm und x86. Beim LLM-Decoding (llama.cpp) mit 64 Kernen erreicht die Plattform die beste Energieeffizienz und übertrifft Intel bei der Durchsatzrate. Im Monte-Cimone-Generationenvergleich bedeutet MCv3 gegenüber MCv1 ≈100× Bandbreite, 158× FP64 pro Knoten und 10× Energieeffizienz. Preprint, nicht begutachtet.

خلاصه (FA)

پیش‌چاپ arXiv:2610.32632v1 که در ۲۳ اکتبر ۲۰۲۶ ارسال شده (دانشگاه بولونیا و ETH زوریخ)، تراشهٔ Sophgo SG2044 با ۶۴ هستهٔ RISC-V را با NVIDIA Grace و Intel Xeon Platinum 8480+ روی یک پشتهٔ نرم‌افزاری و یک روش‌شناسی مقایسه می‌کند.

اعداد: ۸٫۰۲ گیگافلاپ FP64 و ۷٫۸ گیگابایت بر ثانیه به‌ازای هر هسته؛ ۲۹۴ گیگافلاپ و ۱۰۷ گیگابایت بر ثانیه با ۶۴ هسته؛ مقیاس‌پذیری تقریباً خطی تا ۱۶ هسته و سپس اشباع پهنای باند حافظه. عملکرد مطلق هنوز ۸ تا ۱۵ برابر کمتر از Arm و x86 است. در رمزگشایی LLM با llama.cpp روی ۶۴ هسته، بهترین بازده انرژی و بیشترین توان‌دهی نسبت به Intel را دارد. در مقایسهٔ نسل‌های Monte Cimone، MCv3 نسبت به MCv1 حدود ۱۰۰ برابر پهنای باند، ۱۵۸ برابر FP64 در سطح گره و ۱۰ برابر بازده انرژی دارد. این متن یک پیش‌چاپ بدون داوری همتا است.

Sources / 参考来源

← Back to Tech Blog