◆ What
Discrete diffusion for text generation
◆ How
SEDDTransformersPyTorch
Built on: Nanochat Experiments
◆ Why
The Lab + Pioneer
Supporting: Solid production work
Overview
Novel comparison of diffusion vs autoregressive approaches for domain-specific text generation. Using SEDD and nanodiffusion frameworks to explore non-autoregressive language modeling.
Technologies
SEDDTransformersPyTorch