The Role of Data in Machine Learning
Modern algorithms, such as deep learning and reinforcement learning, improve significantly as they are fed more data. This is contrary to older algorithms, which tend to plateau in performance after a certain point. Andrew Ng is quoted saying, 'Moore’s law and some very clever technical work keep pushing the asymptote out,' highlighting the continuous improvement in algorithm performance with increasing data. Tesla’s fleet of cars, which share data about roadside objects to collectively improve their understanding and performance, exemplifies this concept.