6.5930/1 Hardware Architecture for Deep Learning - Spring 2024


Top
Course Info
Staff
Announcements
Syllabus
Reading List
Lecture Notes
Recitations
Labs
Paper Review
Collaboration Policy
6.5930/1 Spring 2024 Syllabus

For 6.5930/1 reading assignment details, click here.

NOTE: Schedule is still tentative and subject to changes.

Monday Wednesday Friday

Feb 05 - L01

Introduction

Lab1 posted

Feb 07 - L02

Overview of DNN components

Feb 09 - Recitation

Machine Learning Review/PyTorch

Feb 12 - L03

Popular Models; Evaluation and Training

Feb 14 - L04

Transformers

Feb 16 - Recitation

Architecture Overview - 1

Feb 19(Tue) - L05

Kernel Computation - CPU

Feb 21 - L06

Kernel Computation - Memory

Feb 23 - Recitation

Architecture Overview - 2

Feb 26 - L07

Kernel Computation - Vectorization

Lab1 due

Lab2 posted

Feb 28 - L08

Transforms

Mar 01 - No Recitation

Mar 04 - L09

GPUs

Mar 06 - L10

Accelerator Architecture

Mar 08 - Recitation

Accelergy

Mar 11 - L11

Dataflows - 1

Lab2 due

Lab3 posted

Mar 13 - L12

Dataflows - 2

Mar 15 - Recitation

Timeloop

Mar 18 - L13

Convolutional Mappings

Mar 20 - L14

Calculating Data Movement

Mar 22 - No Recitation

Mar 25 - Holiday

Mar 27 - Holiday

Mar 29 - Holiday

Apr 01 - L15

Sparsity

Project Release

Review paper assigned

Apr 03 - L16

Sparse Architectures - 1

Lab3 due

Lab4 posted

Apr 05 - Recitation

Sparseloop

Apr 08 - L17

Sparse Architectures - 2

Submit final project selection (or proposal)

Apr 10 - L18

Sparse Matrix Multiplication

Apr 12 - Quiz 1

Apr 15 - Holiday

Apr 17 - L19

Numeric Precision

Apr 19 - No Recitation

Paper Phase I due

Apr 22 - L20

Advanced Technology (CiM)

Lab4 due

Apr 24 - L21

Lab5 posted

CiM -- design decisions/taxonomy

Apr 26 - Recitation

CiMLoop

Paper Phase II due

Apr 29 - L19

Interconnects

May 01

Advanced Technology (Optical)

May 03 - No Recitation

May 06

Sustainability

Project report due

May 08

Project Presentations

May 10 - No Recitation

May 13

Project Presentations

Lab5 due