26 November 2024
09:30 - 11:00 AM
4KD503
Markson Chen
Internal KCN: The Bitter Lesson, Scaling Laws, and Foundation Model for Neuroscience
Markson will mainly discuss the paper "The Brain's Bitter Lesson: Scaling Speech Decoding With Self-Supervised Learning" (https://arxiv.org/pdf/2406.04328 ) while explaining its whole backstory — The Bitter Lesson and Scaling Laws.
The Bitter Lesson: https://www.cs.utexas.edu/~eunsol/courses/data/bitter_lesson.pdf
Scaling Laws for Neural Language Models: https://arxiv.org/abs/2001.08361