July 14th, 2024

Fitting an elephant with four non-zero parameters

The paper discusses addressing Fermi's critique of Dyson's model by fitting an elephant with four non-zero parameters, aiming to define the problem accurately and proposing a new solution. It provides insights into mathematical modeling challenges.

Read original articleLink Icon
HumorParametersModeling
Fitting an elephant with four non-zero parameters

The paper titled "Fitting an Elephant with Four non-Zero Parameters" by Dian Jin and Junze Yuan addresses Enrico Fermi's critique of Dyson's model, referencing Johnny von Neumann's statement about fitting an elephant with parameters. While previous attempts have been made to fit an elephant using four parameters, the problem lacked a clear definition, leading to unsatisfactory results. This paper aims to define the problem accurately and presents a new attempt to fit an elephant with four non-zero parameters. The authors highlight the challenges faced in previous methods and propose a solution in their work. The study falls under the subject of History and Overview in mathematics. The paper provides insights into the mathematical modeling of complex shapes and the significance of parameter selection in fitting models accurately.

Related

Physicists accidentally found a new way to represent pi

Physicists accidentally found a new way to represent pi

Physicists discovered a new pi representation in quantum theory, aiding quantum scattering calculations. The method simplifies pi into components resembling a recipe, potentially impacting hadron scattering analysis and celestial holography.

The Point of the Banach Tarski Theorem

The Point of the Banach Tarski Theorem

The Banach-Tarski theorem challenges common sense by showing a solid ball can be split into pieces to form two identical balls in 3D space. It questions measurement principles and the Axiom of Choice's role in resolving mathematical paradoxes.

Latest Breakthrough from String Theory

Latest Breakthrough from String Theory

Researchers introduced a new series from string theory to enhance pi extraction for quantum calculations. Despite media hype, doubts persist about its novelty and practical benefits, urging careful evaluation amid exaggerated coverage.

Fitting an Elephant with Four Non-Zero Parameters

Fitting an Elephant with Four Non-Zero Parameters

The paper discusses addressing Fermi's critique of Dyson's model by fitting an elephant with four non-zero parameters, aiming to define the problem accurately and proposing a new approach. It contributes to mathematical discussions.

A beginner's guide to LLM quantization and testing

A beginner's guide to LLM quantization and testing

Quantization in machine learning involves reducing model parameters to lower precision for efficiency. Methods like GGUF are explored, impacting model size and performance. Extreme quantization to 1-bit values is discussed, along with practical steps using tools like Llama.cpp for optimizing deployment on various hardware.

AI: What people are saying
The comments on the article about addressing Fermi's critique of Dyson's model by fitting an elephant with four non-zero parameters highlight several key points and themes:
  • Many appreciate the humor and irony in the article, noting its well-written and entertaining nature.
  • There is a discussion on the importance of minimizing parameters in mathematical models to ensure they reflect true aspects of reality rather than just fitting data.
  • Some comments reference historical anecdotes and quotes from Fermi and Neumann, emphasizing the challenge of creating accurate models with minimal parameters.
  • Several comments provide additional resources and references, such as Freeman Dyson's interviews and related scientific papers.
  • There is a debate on the technical aspects of the model, including the necessity and interpretation of the parameters used.
Link Icon 22 comments
By @maitola - 6 months
I love the ironic side of the article. Perhaps they should add the reason for it, from Fermi's and Neumann's. When you are building a model of reality in Physics, If something doesn’t fit the experiments, you can’t just add a parameter (or more) variate it and fit the data. The model should have zero parameters, ideally, or the least possible, or, even at a more deeper level, the parameters should emerge naturally from some simple assumptions. With 4 parameters you don’t know whether you are really capturing a true aspect of reality of just fitting the data of some experiment.
By @elijahbenizzy - 6 months
This is humorous (and well-written), but I think its more than that.

I'm always making the joke (observation) that ML (AI) is just curve-fitting. Whether "just curve-fitting" is enough to produce something "intelligent" is, IMO, currently unanswered, largely due to differing viewpoints on the meaning of "intelligent".

In this case they're demonstrating some very clean, easy-to-understand curve-fitting, but it's really the same process -- come up with a target, optimize over a loss function, and hope that it generalizes, (this one, obviously, does not. But the elephant is cute.)

This raises the question Neumann was asking -- why have so many parameters? Ironically (or maybe just interestingly), we've done a lot with a ton of parameters recently, answering it with "well, with a lot of parameters you can do cool things".

By @EdwardCoffin - 6 months
Freeman Dyson recounts the episode [1] that inspired this paper in his web of life interviews (prepositioned to the fitting an elephant bit) [2]

[1] https://youtu.be/hV41QEKiMlM

[2] https://youtu.be/hV41QEKiMlM?t=118

By @pharmacy7766 - 6 months
By @Steuard - 6 months
Sadly, the constant term (the average r_0) is never specified in the paper (it seems to be something in the neighborhood of 180?): getting that right is necessary to produce the image, and I can't see any way not to consider it a fifth necessary parameter. So I don't think they've genuinely accomplished their goal.

(Seriously, though, this was a lot of fun!)

By @lazamar - 6 months
Lol. Loved it.

This was a lovely passage from Dyson’s Web of Stories interview, and it struck a chord with me, like it clearly did with the authors too.

It happened when Dyson took the preliminary results of his work on the Pseudoscalar theory of Pions to Fermi and Fermi very quickly dismissed the whole thing. It was a shock to Dyson but freed him from wasting more time on it.

Fermi: When one does a theoretical calculation, either you have a clear physical module in mind or a rigorous mathematical basis. You have neither. How many free parameters did you use for your fitting?

Dyson: 4

Fermi: You know, Johnny Von Neumann always used to say ‘with four parameters I can fit an elephant; and with five I can make him wiggle his trunk’.

By @dheera - 6 months
I wish there was more humor on arXiv.

If I could make a discovery in my own time without using company resources I would absolutely publish it in the most humorous way possible.

By @bertm - 6 months
I have to plug Dr Octave Levenspiel. Levenspiel was a professor emeritus when I did my undergrad. He did much of the work on industrial fluidized beds among other things. The elephant curve discussions were a criticism of the complex multi-parameter fitting for heterogenous catalysis of the time. https://levenspiel.com/elephants/

He tried for a while to get an aerodynamics paper published on the flight of dinosaurs. http://levenspiel.com/wp-content/uploads/2016/02/DinosaurW.p...

This intellectual curiosity reminded me a bit of Feynman and his plate spinning.

By @ggm - 6 months
No love for D'Arcy Thompson on growth and form? His parametric models for organisms were quite nice (if very simplistic)

https://en.wikipedia.org/wiki/On_Growth_and_Form

By @lupire - 6 months
IIUC:

A real-parameter (r(theta) = sum(r_k cos(k theta))) Fourier series can only draw a "wiggly circle" figure with one point on each radial ray from the origin.

A compex parameter (z(theta) = sum(e^(z_ theta))) can draw more squiggly figures (epicycles) -- the pen can backtrack as the drawing arm rotates, as each parameter can move a point somewhere on a small circle around the point computed from the previous parameter (and recursively).

Obligatory 3B1B https://m.youtube.com/watch?v=r6sGWTCMz2k

Since a complex parameter is 2 real parameters, we should compare the best 4-cosine curve to the best 2-complex-exponential curve.

By @xpe - 6 months
One take away: Don’t count parameters. Count bits.
By @bee_rider - 6 months
Ya know, in academic writing I tend to struggle with making it sound nice and formal. I try not to use the super-stilted academic style, but it is still always a struggle to walk the line between too loose and too jargony.

Maybe this sort of thing would be a really good tradition. Everyone must write a very silly article with some mathematical arguments in it. Then, we can all go forward with the comfort of knowing that we aren’t really at risk of breaking new grounds in appearing unserious.

It is well written and very understandable!

By @aqme28 - 6 months
> It only satisfies a weaker condition, i.e., using four non-zero parameters instead of four parameters.

Why would that be a harder problem? In the case that you get a zero parameter, you could inflate it by some epsilon and the solution would basically be the same.

By @foobarian - 6 months
Reminds me of an old joke: "What is the difference between an elephant and an aspirin?" - "There isn't any, except the elephant is large, wrinkly and grey."
By @xpe - 6 months
Another take away (not directly stated in the article but implied): Counting the information content of a model is more than just the parameters; the structure of the model itself conveys information.
By @pietroppeter - 6 months
Love how they misspelled Piantadosi as Paintadosi :)
By @classified - 6 months
What is that horizontal bar above r0 in the last equation?
By @tagami - 6 months
ATCG
By @boywitharupee - 6 months
what's the purpose of this? is it one of those 'fun' problems to solve?