July 24th, 2024

Linear Algebra for Data Science

Professors Kyunghyun Cho and Wanmo Kang have created a linear algebra textbook focused on data science, emphasizing practical concepts like SVD, with a non-traditional structure and positive feedback from KAIST students.

Read original articleLink Icon
Linear Algebra for Data Science

Professors Kyunghyun Cho and Wanmo Kang have developed a new textbook on linear algebra aimed at enhancing the teaching of the subject in the context of data science and artificial intelligence. They emphasize the importance of practical concepts such as projection and singular value decomposition (SVD), which are often overlooked in traditional courses that prioritize invertibility and mathematical convenience. The textbook is structured to introduce these practical concepts early on, ensuring that students can grasp useful results and algorithms without sacrificing mathematical rigor.

The table of contents reflects a non-traditional order, placing SVD before determinants and eigendecomposition, which aligns with an optimization/variational approach to problem-solving. This method allows for a deeper understanding of linear algebra concepts through real-world applications rather than solely through algebraic derivations. Additionally, the textbook includes appendices covering related topics such as convexity, covariance matrices, and spectral decomposition, which are essential for understanding linear algebra results.

The textbook has been utilized in a course at KAIST, receiving positive feedback that has influenced its organization. The authors invite feedback and comments from readers to further improve the material. The textbook is available in both English and a mixed Korean-English version to accommodate a wider range of students.

Link Icon 3 comments
By @fifilura - 4 months
If I were to teach linear algebra I would stick to the 3D graphics approach. Maybe as far as including labs for implementing a ray-tracer.

It is just the most fun, intuitive and eye opening application of basic linear algebra.

Don't forget the fun!

Data science applications can come later.

By @bdjsiqoocwk - 4 months
I didn't go to university for CS. Instead I did physics. Because of that, learning/remind myself of this stuff was relatively easy, and so I did it.

And let me tell you, it didn't actually made me a better data scientist/model builder, for the same reason that learning how to implement some tree traversal didnt make me a better programmer.

By @quibono - 4 months
This seems to be a more hands-on linear algebra intro, starting with matrices and building up from there. Note I've not actually read the whole thing, just skimmed it.

Something similar worth looking at is: https://ocw.mit.edu/courses/18-065-matrix-methods-in-data-an...