Link Menu Expand (external link) (LinkedIn) Copy Copied
When
Thu 28-May 12:00 PM - 2:00 PM
Location
Level 3 Birch Building, 35 Science Road, Canberra
Registration
Registration Closed
ModeWorkshop ThreadEnabling Technologies
Join the ANU Cybernetics team in an ANU-wide session of the LLMs Unplugged workshop.

Preparation

No pre-reading or prior technical knowledge is required—just bring your curiosity about how information theory shapes our understanding of human and technological communication.

---

However, if you'd like to get a head start on some of the ideas we'll be covering (or if you're just the curious type and you like reading interesting stuff) here are a few free resources.

Andrey Markov & Claude Shannon Counted Letters to Build the First Language-Generation Models covers some of the historical background. Andrey Markov & Claude Shannon Counted Letters to Build the First Language-Generation Models (IEEE Spectrum)

The Dummy's Guide to Modern LLM Sampling covers the "sampling" part of the process in detail, but also has some helpful definitions at the top. Dummy's Guide to Modern Samplers

Brendan O'Conner's slides on N-Gram Language Models are interesting if you want to go further with the maths (although this is much more maths than we'll use - this session really is for everyone).

For Students

Students can attend this event as part of a KNoT, our Knowledge and Being Workshops that can contribute to course requirements. KNoTs are workshops designed to help students develop the skills, knowledge, and ways of being that are essential for working in complex, real-world contexts.

LLMs Unplugged

In this hands-on workshop you will train and use your own language model from scratch - with just pen and paper and a bit of...

Learn more
bars times search arrow-up