Spikey Spheres (2010)
The text explores the challenges of visualizing high-dimensional spheres, emphasizing the complexity of navigating such spaces and the limitations of three-dimensional intuition in understanding their properties.
Read original articleThe text discusses the challenges of visualizing high-dimensional spheres, particularly in the context of optimization problems. It uses an analogy to illustrate how one might conceptualize navigating a landscape in 1800 dimensions, emphasizing the vastness of the space involved. The author explains that traditional visualizations of hill-climbing or descending do not apply well in such high dimensions due to the sheer number of potential positions to explore. For instance, with 1000 discrete points in each dimension, 1800 dimensions yield an astronomical number of possibilities (10^5400).
The author presents a geometric analogy involving circles and spheres in various dimensions to explain how the size of a central sphere changes as dimensions increase. In higher dimensions, the central sphere can become larger than the surrounding spheres, leading to a "spiky" visualization rather than a smooth one. This spikiness is further illustrated by discussing the volume of spherical caps, which diminishes in higher dimensions, suggesting that high-dimensional spheres are not only symmetrical but also exhibit spiky characteristics.
The text concludes by highlighting the complexity of understanding high-dimensional spaces and the limitations of our three-dimensional intuition, stressing that most of the volume in high-dimensional spheres is near the surface rather than in the core. The author acknowledges the contributions of others in refining these ideas.
Related
I've stopped using box plots (2021)
The author critiques box plots for being unintuitive and prone to misinterpretation, advocating for simpler alternatives like strip plots to effectively communicate distribution insights without confusing audiences.
The Point of the Banach Tarski Theorem
The Banach-Tarski theorem challenges common sense by showing a solid ball can be split into pieces to form two identical balls in 3D space. It questions measurement principles and the Axiom of Choice's role in resolving mathematical paradoxes.
The Sphere
The Sphere in Las Vegas features a massive 16K screen for concerts and film screenings, offering immersive experiences with high-resolution visuals and 4DX effects. Despite mixed reviews on a film, it explores the venue's potential in modern entertainment and immersive technologies' societal impact.
Guide to Machine Learning with Geometric, Topological, and Algebraic Structures
The paper discusses the shift in machine learning towards handling non-Euclidean data with complex structures, emphasizing the need to adapt classical methods and proposing a graphical taxonomy to unify recent advancements.
Don't Let Architecture Astronauts Scare You
Joel Spolsky critiques "Architecture Astronauts" for prioritizing high-level abstractions over practical software solutions, urging developers to focus on user needs and tangible outcomes rather than complex architectural concepts.
Here's the Busemann Petty Problem:
Given two origin symmetric convex bodies K and L in n dimensions. Suppose for every linear hyperplane A (passing through the origin) we have vol_{n-1}(K intersect A) \leq vol_{n-1}(L intersect A).
Is it true that vol_{n}(K) < vol_{n}(L)?
[Here vol_k should be thought of as length when k = 1, area when k = 2, and volume in the traditional sense in k = 3.... generalizes quite well to arbitrary dimensions. And sections are these quantities L (resp. K) intersect A]
Turns out the answer is NO! In n \geq 10, it can be explained with the simple examples of K and L being the unit volume (vol_n) cube and a euclidean ball of volume (vol_n) slightly less 1 respectively. Comes from Keith Ball who, in his PhD thesis, established that {n-1}-section volume of the unit volume cube lies in [1, \sqrt(2)]. However for the euclidean ball of unit volume the section volume is at least sqrt(2). So you can start with the unit volume ball, decrease its radius infinitesimally so (the n-1 section volume falls less than the n-volume does) and generate a clear counterexample.
What this looks like is a ball with volume less than a cube but section volume seemingly leaks out of the faces of the cube. So a "spikey ball," if you may.
Boxes are more intuitive
At the end of it all, we have a big list of numbers (a vector) where each position in the list (component/dimension) implies a specific "meaning" that we don't know. We also have a variety of well-known mathematical operations we can do on those lists, the effects of which may depend on the number of positions present (the dimensionality of the vector space).
The challenge would be to find a good intuitive model to explain those effects (and ideally a way to visualise the lists that preserves the effects). Saying "it's an 1800 dimensional sphere" satisfies neither of those properties: You cannot visualise it and even if you want to think about it theoretically, it has none of the intuitive properties of a 2D or 3D sphere.
It is worth your time IMHO.
Then both a sphere with radius 1 and a box with side length 2 will become the same interval, with no difference.
In the OP setup, the middle sphere would vanish completely and (modulo some annoyances at the interval boundaries) become either the empty set or a single-element set, in either case having both radius and volume of zero.
One of the harder generalizations to develop intuition for is the fact that the measure of a d-sphere tends to 0 as d approaches infinity, even though for all d = 0, 1, 2, 3 that our meager brains can visualize, the opposite is true! Geometry goes crazy.
Related
I've stopped using box plots (2021)
The author critiques box plots for being unintuitive and prone to misinterpretation, advocating for simpler alternatives like strip plots to effectively communicate distribution insights without confusing audiences.
The Point of the Banach Tarski Theorem
The Banach-Tarski theorem challenges common sense by showing a solid ball can be split into pieces to form two identical balls in 3D space. It questions measurement principles and the Axiom of Choice's role in resolving mathematical paradoxes.
The Sphere
The Sphere in Las Vegas features a massive 16K screen for concerts and film screenings, offering immersive experiences with high-resolution visuals and 4DX effects. Despite mixed reviews on a film, it explores the venue's potential in modern entertainment and immersive technologies' societal impact.
Guide to Machine Learning with Geometric, Topological, and Algebraic Structures
The paper discusses the shift in machine learning towards handling non-Euclidean data with complex structures, emphasizing the need to adapt classical methods and proposing a graphical taxonomy to unify recent advancements.
Don't Let Architecture Astronauts Scare You
Joel Spolsky critiques "Architecture Astronauts" for prioritizing high-level abstractions over practical software solutions, urging developers to focus on user needs and tangible outcomes rather than complex architectural concepts.