Open ISA Supercomputing: SG2044 Reaches 294 GFLOP/s at 64 Cores, Beats Xeon on LLM Decode
RISC-V's HPC story has suffered from a measurement problem: every paper used a different board, a different software stack and rarely reported energy at all, so "RISC-V is 5x slower" and "RISC-V is competitive" could both be published about the same year. A preprint submitted to Future Generation Computer Systems on 23 October 2026 fixes the methodology first and the conclusion second — one software stack, one methodology, nine benchmarks, three architectures, and wall power measured properly.
What Was Measured, and Against What
Twelve authors from the University of Bologna and ETH Zurich (Emanuele Venieri, Giacomo Madella, Gabriele Ceccolini, Simone Manoni, Federico Ficarelli, Filippo Barbari, Jenny Lynn Almerol, Elisabetta Boella, Nitin Shukla, Simone Bnà, Luca Benini, Andrea Bartolini) characterise the Sophgo SG2044 — the 64-core RISC-V server SoC — and compare it with two incumbent platforms.
| Platform | Role in the study |
|---|---|
| Sophgo SG2044 | The RISC-V subject: 64 cores, the first mass-available multi-core RISC-V server part |
| NVIDIA Grace CPU Superchip | Arm reference, server-class |
| Intel Xeon Platinum 8480+ | x86 reference, Sapphire Rapids generation |
Four HPC benchmarks and four real applications, all built from a common stack:
| Class | Workloads | What it stresses |
|---|---|---|
| Benchmarks | STREAM, HPL, HPL-MxP, HPCG | Memory bandwidth, FP64 dense and mixed-precision linear algebra, sparse/conjugate-gradient behaviour |
| Applications | iPIC3D, PLUTO, OpenFOAM, llama.cpp | Particle-in-cell plasma, astrophysical MHD, CFD, LLM inference |
One methodological detail is worth flagging because it is the difference between a fair test and a benchmark-shaped one: the authors built a version of HPL-MxP linked against OpenBLAS for this work and released it as open source. Without OpenBLAS the RISC-V run would have had no competitive BLAS to sit on, and the mixed-precision number would have been meaningless.
The Numbers
| Metric | SG2044 result | Source |
|---|---|---|
| FP64, per core | 8.02 GFLOP/s | Paper, measured |
| Memory bandwidth, per core | 7.8 GB/s | Paper, measured |
| FP64, 64 cores | 294 GFLOP/s | Paper, measured |
| Memory bandwidth, 64 cores | 107 GB/s | Paper, measured |
| Scaling | Near-linear to 16 cores; memory-bandwidth saturation beyond | Paper, with L2-cache-aware process placement |
| Absolute performance vs Grace / Xeon 8480+ | 8–15× lower | Paper, measured |
| LLM decode, 64 cores | Highest relative scaling and energy efficiency of the three platforms; higher throughput than Intel | Paper, measured |
Two of those lines deserve to be read together, because they look contradictory and are not. 294 GFLOP/s across 64 cores is roughly 4.6 GFLOP/s per core at scale against 8.02 GFLOP/s measured for a single core: 57% parallel efficiency by FP64 peak. That is not a bad number for a first-generation 64-core open-ISA part, and it is consistent with the paper's own diagnosis — scaling stops being near-linear after 16 cores because 107 GB/s of shared memory bandwidth saturates, not because the cores are slow. Bandwidth is the wall, not compute.
Monte Cimone: Three RISC-V Generations, One Line
The most useful part of the paper is not the cross-architecture comparison at all — it is the within-RISC-V comparison across the Monte Cimone (MC) cluster generations, an Italian RISC-V HPC testbed. Because these are successive RISC-V systems measured with the same stack, the deltas are pure generational progress, unpolluted by ISA differences.
| Generation | Against | Improvement |
|---|---|---|
| MCv3 (SG2044-based) | MCv2 | 2× single-core performance; 2× peak memory bandwidth |
| MCv3 (SG2044-based) | MCv1 | ≈100× memory bandwidth; 158× node-level FP64 performance; 10× energy efficiency |
The MCv1→MCv3 numbers are not a chip refresh, they are a category change — two orders of magnitude in bandwidth and 158× in node FP64 inside one project's lifetime. Anyone planning a three-to-five year RISC-V roadmap should treat those as the observed slope rather than assuming the current part is what they will be competing against.
Where RISC-V Actually Wins Today: LLM Decode
The result that will get quoted is this one: on llama.cpp LLM decode, 64-core SG2044 execution delivered the highest relative scaling and the highest energy efficiency of the three platforms, and exceeded the Intel Xeon 8480+ in throughput.
It is worth being precise about why that is plausible rather than surprising. Autoregressive decode at batch 1 is memory-bound: every token requires streaming the weights, so throughput tracks memory bandwidth and capacity, not FP64 peak or vector width. The SG2044's weakness — narrow vector resources on an older node — is exactly the thing decode does not care about, while its 64 general-purpose cores and aggregate bandwidth are the things it does. That is also exactly the workload profile the authors of a separate study would call a new rather than existing market: decode and agent-style serving are loads without twenty years of x86-tuned legacy software behind them.
The Three Things the Paper Says Are Still Missing
The authors are explicit about attribution: the 8–15× absolute gap reflects narrower vector resources and a less advanced technology node — the first is an ISA-implementation choice, the second is a fab choice. Neither is a property of RISC-V itself, and both are addressable within the same architecture. Their conclusion is correspondingly measured: RISC-V processors are closing the gap, not that they have closed it.
| Bottleneck | Evidence | What would move it |
|---|---|---|
| Vector width and implementation quality | Explicitly named as the cause of the per-core deficit | Wider VLEN, better RVV scheduling; the same gap the kernel community is chasing with auto-vectorisation work |
| Process node | Stated as the second cause of the absolute gap | Vendor decision, not an ISA decision — but it sets the ceiling no software can lift |
| Memory bandwidth saturation | Near-linear scaling stops at 16 cores; 107 GB/s at 64 cores | More bandwidth per socket, or bandwidth-aware placement; the paper's L2-aware placement already recovers most of the loss |
Builder Takeaways
- Use this paper as your neutral baseline. It is the first cross-architecture HPC comparison on one software stack that also reports energy. If a vendor quotes a RISC-V HPC speedup against x86 without a stack description and a watt figure, this is the number to check it against.
- Bandwidth, not TOPS, is the design constraint. 57% FP64 parallel efficiency and a 16-core scaling knee say the same thing: for a 64-core RISC-V design, memory subsystem budget is where the next 2× lives.
- Pick the workload before the ISA. A part that is 8–15× down on FP64 is simultaneously ahead on LLM decode throughput. Neither fact is useful in isolation.
- The MCv1→MCv3 delta (100× bandwidth, 158× FP64, 10× energy) is the real planning input. RISC-V HPC in 2029 will not be this chip with bug fixes.
- OpenBLAS and open-sourced test harnesses matter. The authors shipped the OpenBLAS-linked HPL-MxP they built; that kind of artefact is what makes a benchmark reproducible instead of rhetorical.
中文摘要
2026 年 10 月 23 日,一篇投递给 Future Generation Computer Systems 的预印本(arXiv:2610.32632v1)用同一套软件栈与方法学,把等国 SG2044(64 核 RISC-Vﺹ与 NVIDIA Grace、Intel Xeon Platinum 8480+ 放在同一把尺子上。
实测数据(论文原值):单核 FP64 8.02 GFLOP/s、单核内存带宽 7.8 GB/s;64 核 FP64 294 GFLOP/s、带宽 107 GB/s。依赖 L2 感知的进程数据布置,扩展在 16 核以内接近线性,之后被共享带宽饱和卡住。相对 Arm 与 x86 的绝对性能仍差 8–15×。
亮点:在 llama.cpp 的 LLM decode 上,64 核 SG2044 的相对扩展效率与能效在三平台中最高,并且吞吐量超过 Intel Xeon 8480+。原因不难理解:batch=1 的自回归解码是内存带宽型负载,不吃向量宽度。
代际进步(Monte Cimone 集群):MCv3 相对 MCv1,带宽约 100×、节点级 FP64 158×、能效 10×,单核和带宽相对 MCv2 各翻 2×。
罢论与边界:论文自己归因为“向量资源较窄”与“工艺节点较旧”,并明确结论是“正在缩小差距”而非“已经追平”。此文为预印本,尚未同行评审。
对开发者的意义:设计 64 核 RISC-V 时,带宽预算比 TOPS 更关键;先选负载再选 ISA,因为同一颗芯片可以同时“FP64 落后 10 倍”和“decode 超越 Xeon”。
Краткое содержание (RU)
Препринт arXiv:2610.32632v1 от 23 октября 2026 (Болоньский университет / ETH Цюрих) сравнивает Sophgo SG2044 (64 ядра RISC-V) с NVIDIA Grace и Intel Xeon Platinum 8480+ на едином программном стеке.
Цифры: 8,02 GFLOP/s FP64 и 7,8 GB/s на ядро, 294 GFLOP/s и 107 GB/s на 64 ядрах; почти линейное масштабирование до 16 ядер, затем насыщение полосы памяти. Абсолютное отставание от Arm и x86 — 8–15×. На LLM-decode (llama.cpp) 64 ядра дают лучшую энергоэффективность и превосходят Intel по пропускной способности. По колению Monte Cimone: MCv3 против MCv1 — ≈100× по полосе, 158× по FP64 на узел, 10× по энергоэффективности. Это препринт, не прошедший рецензирование.
Resumen (ES)
El prepint arXiv:2610.32632v1, enviado el 23 de octubre de 2026 (Universidad de Bolonia / ETH Zúrich), compara el Sophgo SG2044 de 64 núcleos RISC-V con NVIDIA Grace y un Intel Xeon Platinum 8480+ usando una única pila de software y metodología.
Cifras: 8,02 GFLOP/s FP64 y 7,8 GB/s por núcleo; 294 GFLOP/s y 107 GB/s con 64 núcleos; escalado casi lineal hasta 16 núcleos y saturación de ancho de banda después. El rendimiento absoluto sigue siendo 8–15× inferior al de Arm y x86. En decodificación LLM (llama.cpp) con 64 núcleos obtiene la mejor eficiencia energética y supera en throughput al Intel. En la comparación generacional Monte Cimone, MCv3 frente a MCv1 supone ≈100× de ancho de banda, 158× de FP64 por nodo y 10× de eficiencia energética. Es un prepint, sin revisión por pares.
Résumé (FR)
La prépublication arXiv:2610.32632v1, soumise le 23 octobre 2026 (université de Bologne / ETH Zurich), compare le Sophgo SG2044 à 64 cœurs RISC-V à NVIDIA Grace et à un Intel Xeon Platinum 8480+, avec une pile logicielle et une méthodologie uniques.
Chiffres : 8,02 GFLOP/s FP64 et 7,8 GB/s par cœur ; 294 GFLOP/s et 107 GB/s à 64 cœurs ; mise à l'échelle quasi linéaire jusqu'à 16 cœurs, puis saturation de la bande passante. Les performances absolues restent 8 à 15 fois inférieures à Arm et x86. En décodage LLM (llama.cpp) à 64 cœurs, la plateforme obtient la meilleure efficacité énergétique et dépasse l'Intel en débit. Sur la comparaison générationnelle Monte Cimone, MCv3 face à MCv1 représente ≈100× de bande passante, 158× de FP64 par nœud et 10× d'efficacité énergétique. Prépublication non évaluée par les pairs.
Kurzfassung (DE)
Das Preprint arXiv:2610.32632v1 (eingereicht am 23. Oktober 2026, Universität Bologna / ETH Zürich) vergleicht den Sophgo SG2044 mit 64 RISC-V-Kernen gegenüber NVIDIA Grace und einem Intel Xeon Platinum 8480+ — mit identischem Software-Stack und identischer Methodik.
Zahlen: 8,02 GFLOP/s FP64 und 7,8 GB/s pro Kern; 294 GFLOP/s und 107 GB/s bei 64 Kernen; nahezu lineare Skalierung bis 16 Kerne, danach Speicherbandbreitensättigung. Die absolute Leistung liegt weiterhin 8–15× unter Arm und x86. Beim LLM-Decoding (llama.cpp) mit 64 Kernen erreicht die Plattform die beste Energieeffizienz und übertrifft Intel bei der Durchsatzrate. Im Monte-Cimone-Generationenvergleich bedeutet MCv3 gegenüber MCv1 ≈100× Bandbreite, 158× FP64 pro Knoten und 10× Energieeffizienz. Preprint, nicht begutachtet.
خلاصه (FA)
پیشچاپ arXiv:2610.32632v1 که در ۲۳ اکتبر ۲۰۲۶ ارسال شده (دانشگاه بولونیا و ETH زوریخ)، تراشهٔ Sophgo SG2044 با ۶۴ هستهٔ RISC-V را با NVIDIA Grace و Intel Xeon Platinum 8480+ روی یک پشتهٔ نرمافزاری و یک روششناسی مقایسه میکند.
اعداد: ۸٫۰۲ گیگافلاپ FP64 و ۷٫۸ گیگابایت بر ثانیه بهازای هر هسته؛ ۲۹۴ گیگافلاپ و ۱۰۷ گیگابایت بر ثانیه با ۶۴ هسته؛ مقیاسپذیری تقریباً خطی تا ۱۶ هسته و سپس اشباع پهنای باند حافظه. عملکرد مطلق هنوز ۸ تا ۱۵ برابر کمتر از Arm و x86 است. در رمزگشایی LLM با llama.cpp روی ۶۴ هسته، بهترین بازده انرژی و بیشترین تواندهی نسبت به Intel را دارد. در مقایسهٔ نسلهای Monte Cimone، MCv3 نسبت به MCv1 حدود ۱۰۰ برابر پهنای باند، ۱۵۸ برابر FP64 در سطح گره و ۱۰ برابر بازده انرژی دارد. این متن یک پیشچاپ بدون داوری همتا است.
Sources / 参考来源
- arXiv:2610.32632v1 — “Toward Open ISA Supercomputing: A Comparative Study of RISC-V, Arm, and x86 Architectures on HPC Workloads”, submitted Fri 23 Oct 2026 13:43:38 UTC (831 KB), preprint submitted to Future Generation Computer Systems
- arXiv — full PDF (benchmark methodology, STREAM/HPL/HPL-MxP/HPCG, application results)
- DOI 10.48550/arXiv.2610.32632
- SOPHGO — SG2044 platform vendor documentation