Semidynamics Tensor Unit
The general ensemble with the Atrevido-423 core, the Gazzillion Unit, the Vector Unit and the Tensor Unit
Optimised for its 64-bit totally customisable RISC-V cores
— Roger Espasa, Semidynamics’ CEO and founder,
BARCELONA, SPAIN, October 24, 2023 /EINPresswire.com/ — Semidynamics has simply introduced a RISC-V Tensor Unit that’s designed for ultra-fast AI options and is predicated on its totally customisable 64-bit cores.
State-of-the-art Machine Studying fashions, corresponding to LLaMa-2 or ChatGPT, include billions of parameters and require a big computation energy within the order of a number of trillions of operations per second. Delivering such large efficiency whereas conserving power consumption low poses a major problem for {hardware} design. The answer to this downside is the Tensor Unit that gives unprecedented computation energy for performance-hungry AI applications. The majority of computations in Massive Language Fashions (LLMs) is in fully-connected layers that may be effectively carried out as matrix multiplication. The Tensor Unit supplies {hardware} particularly tailor-made to matrix multiplication workloads, leading to an enormous efficiency enhance for AI.
The Tensor Unit is constructed on high of the Semidynamics RVV1.0 Vector Processing Unit and leverages the present vector registers to retailer matrices. This permits the Tensor Unit to be used for layers that require matrix multiply capabilities, corresponding to Absolutely Related and Convolution, and use the Vector Unit for the activation perform layers (ReLU, Sigmoid, Softmax, and many others), which is a giant enchancment over stand-alone NPUs that normally have bother coping with activation layers.
The Tensor Unit leverages each the Vector Unit capabilities in addition to the Atrevido-423 Gazzillion™ capabilities to fetch the info it wants from reminiscence. Tensor Models eat knowledge at an astounding fee and, with out Gazzillion, a traditional core wouldn’t sustain with the Tensor Unit’s calls for. Different options depend on difficult-to-program DMAs to clear up this downside. As an alternative, Semidynamics seamlessly integrates the Tensor Unit into its cache-coherent subsystem, opening a brand new period of programming simplicity for AI software program.
As well as, as a result of the Tensor Unit makes use of the vector registers to retailer its knowledge and doesn’t embrace new, architecturally-visible state, it seamlessly works below any RISC-V vector-enabled Linux with none adjustments.
Semidynamics’ CEO and founder, Roger Espasa, stated, “This new Tensor Unit is designed to totally combine with our different progressive applied sciences to present options with excellent AI efficiency. First, on the coronary heart, is our 64-bit totally customisable RISC-V core. Then our Vector Unit which is continually fed knowledge by our Gazzillion know-how in order that there are not any knowledge misses. After which the Tensor Unit that does the matrix multiplications required by AI. Each stage of this answer has been designed to be totally built-in with the others for optimum AI efficiency and really straightforward programming. The result’s a efficiency improve of 128x in contrast to simply operating the AI software program on the scalar core. The world desires super-fast AI options and that’s what our distinctive set of applied sciences can now present.”
Additional particulars on the Tensor Unit shall be disclosed on the RISC-V North America Summit in Santa Clara on November seventh 2023.
Semidynamics www.semidynamics.com
Based in 2016 and based mostly in Barcelona, Spain, Semidynamics™ is the one supplier of totally customisable RISC-V processor IP and specialises in excessive bandwidth, excessive efficiency cores with vector items and tensor items focused at machine studying and AI applications. The corporate is privately owned and is a strategic member of the RISC-V Alliance.
Enquiries to information@semidynamics.com
Semidynamics, Open Core Surgical procedure, Gazzillion and Atrevido are logos of Semidynamics
Media contact
Nigel Robson, Vortex PR. nigel@vortexpr.com +44 1481 233080
Laura Batlle, Communications Director, Semidynamics, laura.batlle@semidynamics.com
+34 934 068 704
Nigel Robson
Vortex PR
e mail us right here
Go to us on social media:
LinkedIn
