Show HN: Minigrad – a small neural network lib in Golang
The GitHub repository hosts "minigrad," a Golang neural network library resembling PyTorch, featuring an autograd engine. Users can contribute via issues, pull requests, and testing. The library is MIT-licensed.
Read original article
The GitHub repository contains "minigrad," a Golang neural network library inspired by PyTorch for easy and fast usage. It is built on an autograd engine and is a Go implementation of Andrej Karpathy's Micrograd. Users can perform operations like addition, multiplication, exponentiation, and more using the library. Contributions to the project are welcome through issue reporting, pull requests for improvements or bug fixes, and adding test cases. The library is licensed under the MIT license, allowing users to utilize and modify the code as needed.
Related
Show HN: UNet diffusion model in pure CUDA
The GitHub content details optimizing a UNet diffusion model in C++/CUDA to match PyTorch's performance. It covers custom convolution kernels, forward pass improvements, backward pass challenges, and future optimization plans.
LivePortrait: A fast, controllable portrait animation model
The GitHub repository contains the PyTorch implementation of "LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control" project. It provides instructions for setup, inference, Gradio interface usage, speed evaluation, acknowledgements, and citations.
LightRAG: The PyTorch Library for Large Language Model Applications
The LightRAG PyTorch library aids in constructing RAG pipelines for LLM applications like chatbots and code generation. Easy installation via `pip install lightrag`. Comprehensive documentation at lightrag.sylph.ai.
Karpathy: Let's reproduce GPT-2 (1.6B): one 8XH100 node 24h $672 in llm.c
The GitHub repository focuses on the "llm.c" project by Andrej Karpathy, aiming to implement Large Language Models in C/CUDA without extensive libraries. It emphasizes pretraining GPT-2 and GPT-3 models.
gpu.cpp: A lightweight library for portable low-level GPU computation
The GitHub repository features gpu.cpp, a lightweight C++ library for portable GPU compute using WebGPU. It offers fast cycles, minimal dependencies, and examples like GELU kernel and matrix multiplication for easy integration.
2 commentsRelated
Show HN: UNet diffusion model in pure CUDA
The GitHub content details optimizing a UNet diffusion model in C++/CUDA to match PyTorch's performance. It covers custom convolution kernels, forward pass improvements, backward pass challenges, and future optimization plans.
LivePortrait: A fast, controllable portrait animation model
The GitHub repository contains the PyTorch implementation of "LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control" project. It provides instructions for setup, inference, Gradio interface usage, speed evaluation, acknowledgements, and citations.
LightRAG: The PyTorch Library for Large Language Model Applications
The LightRAG PyTorch library aids in constructing RAG pipelines for LLM applications like chatbots and code generation. Easy installation via `pip install lightrag`. Comprehensive documentation at lightrag.sylph.ai.
Karpathy: Let's reproduce GPT-2 (1.6B): one 8XH100 node 24h $672 in llm.c
The GitHub repository focuses on the "llm.c" project by Andrej Karpathy, aiming to implement Large Language Models in C/CUDA without extensive libraries. It emphasizes pretraining GPT-2 and GPT-3 models.
gpu.cpp: A lightweight library for portable low-level GPU computation
The GitHub repository features gpu.cpp, a lightweight C++ library for portable GPU compute using WebGPU. It offers fast cycles, minimal dependencies, and examples like GELU kernel and matrix multiplication for easy integration.