See my Google Scholar profile for the most up-to-date record of my publications.
Published in Presented at the Summer@Simons poster session., 2024
This paper studies the gradient flow dynamics teacher-student distillation setup with squared loss and multiple student and teacher neurons.
Recommended citation: Berkan Ottlik. (2024). "Gradient Flow Dynamics of Teacher-Student Distillation with the Squared Loss". https://berkan.xyz/files/underparameterizedDynamics.pdf
Published in Presented at the Fall Fourier Talks, University of Maryland, 2024
This paper studies an online version of the light bulb problem and gives simple lower-bounds and develops algorithms that allude to a space-runtime tradeoff.
Recommended citation: Noah Bergam, Berkan Ottlik, Arman Özcan. (2024). "A Sequential Lightbulb Problem". https://berkan.xyz/files/lightbulb.pdf
Published in ICLR 2024 Workshop on Understanding of Foundation Models (ME-FoMo), 2024
This paper investigates the relationship between model capacity and the emergence of in-context learning under a simplified statistical framework in the transformer model.
Recommended citation: Berkan Ottlik, Narutatsu Ri, Daniel Hsu, Clayton Sanford. (2024). "The Effect of Model Capacity on the Emergence of In-Context Learning" ICLR 2024 Workshop on Understanding of Foundation Models (ME-FoMo). https://openreview.net/pdf?id=YZM9g0Mi9a
Published in Fall Technical Forum: SCTE, NCTA, CableLabs, 2021
This paper discusses uses machine learning to classify types radio frequency impairments in cable modems.
Recommended citation: Berkan Ottlik, Brady Volpe. (2021). "Machine Learning and Proactive Network Maintenance: Transforming Today's Plant Operations" 2021 Fall Technical Forum: SCTE, NCTA, CableLabs. https://www.nctatechnicalpapers.com/Paper/2021/2021-machine-learning-and-proactive-network-maintenance-transforming-today-s-plant-operations/