This aesthetics in physics that is hard to explain to someone outside the field. How beautiful for example that you can express the whole classical mechanics in just 1 equation and electro magnetism in 4, that sense of symmetry and clarity they express. Essentially in what Einstein and others believed: that the universe is a orderly place not chaos and that its rules can be understood by our crippled minds.
And I think there is a similar notion in code. As physicists are driven to more general and powerful theories that shall some time explain all interactions of matter that we know of, programmers, I believe, strive for similar ideals: brevity, conciseness, generality, abstraction, powerfulness of your symbolic system - one line of code to end it all.