18 May 2024: Add a tutorial on counting Transformer FLOPs (Equation 6 in the paper). Figure 1: (a) Architecture of Gated CNN and Mamba blocks (omitting Normalization and shortcut). The Mamba block ...

This project is a step-by-step learning journey where we implement various types of Triton kernels—from the simplest examples to more advanced applications—while exploring GPU programming with Triton.

Unemployment is a major concern of societies and people around the world. In addressing this phenomenon, the literature has suggested a change in unemployed people’s perceptions of this transition ...

In most applications, functional materials operate at finite temperatures and are in contact with a reservoir of atoms or molecules (gas, liquid, or solid). In order to understand the properties of ...