Code Monkey home page Code Monkey logo

riscv-llm's Introduction

RISC-V LLM (using QEMU for now)

This repository is used for some preliminary testing of the RISCV-LLM project. It is based on the RISC-V Getting Started Guide and the RISCV-Bringup repository.

CI

LLM Inference Test RISC-V Vector Intrinsics Test RISC-V Ubuntu 22.04 Booting

Features

  • RISC-V QMEU setup running Ubuntu22.04 with RISC-V Vector Extension (RVV) v1.0 (v0.7.1 is not supported in QEMU)
  • GCC 13.2 with RVV 1.0 support including RVV intrinsics v0.11
  • CI Pipeline for building and testing the RISC-V LLM project

Llama 2 7B Example

One example taken from the CI:

What do you think about RISC-V?

RISC-V (RISC Virtual Machine) is an open-source instruction set architecture (ISA) that was designed to be simple, efficient, and extensible. It was first introduced in 2010 by the University of California, Berkeley and is now maintained by the RISC-V Foundation, a non-profit organization.

Setup

Install QEMU from scratch

Run

git submodule update --init --recursive
./scripts/install_qemu.sh
source env.sh

# download the vm
wget https://iis.ee.ethz.ch/~janniss/scratch_schneematt/ubuntu-riscv-vector-new.tar.gz
tar -xvf ubuntu-riscv-vector-new.tar.gz \
    && mv ubuntu-22.04-gcc-13-backup/ ubuntu-riscv-vector/ \
    && rm ubuntu-riscv-vector-new.tar.gz
cd ubuntu-riscv-vector

# boot the VM
./start_riscv.sh

Docker setup

There is a prepared docker image. Which includes the RISC-V VM.

docker pull ghcr.io/joennlae/qemu-riscv-vec
docker run -it --rm ghcr.io/joennlae/qemu-riscv-vec

Resources

riscv-llm's People

Contributors

joennlae avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.