Yi WangCMake: Define FunctionsUnderstanding the function definition with CMake will help us understand usual function calls.2 min read·Jan 5, 2023----
Yi WangCompare Deep Learning Toolkits: Theano, TensorFlow, TensorFlow 2.0, PyTorch, and JAXMy recent work on PyTorch Distributed and TorchRec requires me to learn PyTorch 2.0. At the same time, I am learning JAX and XLA from Alpa…6 min read·Oct 2, 2022----
Yi WangPyTorch DistributedDataParallel InternalsThanks to Shen Li, Yanli Zhao, Alban Desmaison, and Wanchao Liang for teaching me the details about DistributedDataParallel, aka, DDP, the…5 min read·Sep 30, 2022----
Yi WanginThe StartupWhat I Have Done Wrong Leading Baidu’s Open-Source Deep Learning System PaddlePaddleIn late 2016, I was assigned the tech lead of PaddlePaddle, the open-source deep learning system of Baidu.5 min read·Nov 5, 2020----
Yi WangNLP in SQL: Word VectorsIt is a common bias that SQL cannot handle unstructured data like text. However, this is not true. In this article, we explain how to…5 min read·Feb 7, 2020--1--1