← projects

status — archived·November 2022

Shakespearean Text Generator

A GPT built from scratch and trained on a Shakespearean text dataset to generate new text in Shakespeare's style.

PythonPyTorch


Built a generative pre-trained transformer (GPT) from scratch — attention blocks, tokenizer, and training loop — and trained it on a Shakespearean text dataset to generate new text in the style of Shakespeare. One of my first deep dives into how transformer language models actually work under the hood, well before “build your own GPT” was a common exercise.