My new paper on Einstein and general relativity

didMy new paper on Einstein and the general theory of relativity:

PT_3_2979_figures_online_f1

Advertisements

The Genesis and ‘Renaissance’ of General Relativity: Jürgen Renn’s talk

All the Berlin Century of General Relativity and MPIWG conference talks and discussions are on the web site of the Max Planck Institute for the History of Science in Berlin.

I shall begin by presenting the opening remarks of prof. Jürgen Renn’s talk, “The ‘Renaissance’ of General Relativity: Social and Epistemic Factors”, and thereafter I shall list my various comments on this talk. I shall present my views at the end regarding the term “Renaissance” describing the period from 1955 to the end of 1964.

רן2

Prof. Jürgen Renn:

“This talk is about explaining historical change; how we preliminary see the various stages of the history of general relativity: there was the genesis of general relativity [the period from 1907 to 1916] where Einstein worked not quite but almost alone with a few helpers. There were the formative years [the period from 1916 to 1925], in which the theory was discussed among a group of experts; there was then what Jean Eisenstaedt has epically termed the low-water mark period [the period from 1925 to 1955]; and then comes the renaissance [the period from 1955 to 1964]. Clifford Will gave the name to this period; and for us historians then came the golden ages [the period from 1964 to the mid 1970s] and today and the future, but I will not talk about that.

So the main challenge is to explain how development went from the low-water mark period to the renaissance; how what we today see as the basic theory of cosmology and astrophysics came back into the mainstream of physics after the low-water mark period. There were many factors of course and we have concentrated on several scenarios, examining them in preliminary ways to try to come up with what we think as a convincing explanation.

Let me start to outline the thesis. We think that the renaissance was mainly due to two factors:

One was the discovery of the untapped potential of general relativity as it has been created as a tool for theoretical physics. Hidden secrets that were discovered in this period, hidden potential of application, these would not have been explored and actively developed had it not been within a community that was just forming in this period.

[The second factor] We think that the renaissance is also very much history of a community, in which for the first time a real community of relativists and cosmologists emerged. We have kind of loosely been talking of relativists and cosmologists, even when referring to the twenties and the thirties [1920s and 1930s]. This is a somewhat anachronistic use of terms, because the real community only emerged as we see it during the period of the renaissance.

ri

So you see already that the general approach is one that combines epistemological aspects with sociological aspects, and that is very much the spirit of our thinking. Robert Schulmann [a speaker in the conference] used the terminology of internalist and externalist. So we see this very much as a development that can only be understood if you combine the cognitive, the epistemological side, with the sociological developments parallel to it”.

רן

My comments on this talk:

Prof. Jürgen Renn says: “There was the genesis of general relativity where Einstein worked not quite but almost alone with a few helpers. There were the formative years, in which the theory was discussed among a group of experts; there was then what Jean Eisenstaedt has epically termed the low-water mark period”.

I think that even during the genesis of general relativity, between 1912 and 1916, Einstein’s interaction with and response to eminent and non-eminent scientists and his ongoing discussions with other scientists contributed to the formation of general relativity. The efforts invested by physicists like Max Abraham, Gunnar Nordström, Gustav Mie, David Hilbert and others, which presented differing outlooks and discussions revolving around the theory of gravitation, were relegated to the background. Those works that did not embrace Einstein’s overall conceptual concerns – these primarily included the heuristic equivalence principle and Mach’s ideas (later called Mach’s principle) – were rejected, and authors focused on Einstein’s prodigious scientific achievements. However, one cannot discard Einstein’s response to the works of Abraham, Nordström, Mie, Tullio Levi-Civita, Hilbert and others. On the contrary, between 1912 and 1915 (the so-called genesis of general relativity) Einstein’s response to these works, and corrections made by these scientists to his work, constitutes a dynamic interaction that assisted him in his development (so-called genesis) of the general theory of relativity. In my book, General Relativity Conflict and Rivalries I show that general relativity was not developed as a single, coherent construction by an isolated individual, brooding alone. Instead, general relativity was developed through Einstein’s conflicts and interactions with other scientists, and was consolidated by his creative process during these exchanges.

Indeed, performing a historical research and also applying comparative research in a sociological context, we can emphasize the limits and associated problems tracing Einstein’s “odyssey”, i.e. intellectual road to the general theory of relativity. An intellectual approach emphasizes the simplistic hero worship narrative. In addition, some philosophers embrace externalist theories of justification and others embrace internalist theories of justification. There are many different versions of internalism and externalism, and philosophers offered different conceptions of internalism and externalism.

I would like to comment on the “formative years” and the “low-water mark” period. I show in my book General Relativity Conflict and Rivalries that between 1916 and 1955, Einstein was usually trusted as the authority on scientific matters. His authority in physics is revealed even on first-rate mathematicians and physicists. For example, in 1918 Felix Klein demonstrated to Einstein that the singularity in the de Sitter solution to the general relativity field equations was an artefact of the way in which the time coordinate was introduced. Einstein failed to appreciate that Klein’s analysis of the de Sitter solution showed that the singularity could be transformed away. In his response to Klein, Einstein simply reiterated the argument of his critical note on the de Sitter solution. In 1917-1918 the physicist-mathematician Hermann Weyl’s position corresponded exactly to Einstein’s when he criticized de Sitter’s solution; Weyl’s criticism revealed the influence of Einstein’s authority in physics even on first-rate mathematicians like Weyl.

Two other examples from the introduction of my book:

In March 1918, before publishing the book Space-Time-Matter, Weyl instructed his publisher to send Einstein the proofs of his book. In the same month, Weyl also instructed his publisher to send David Hilbert the proofs of his book. Hilbert looked carefully at the proofs of Weyl’s book but noticed that the latter did not even mention his first Göttingen paper from November 20, 1915, “Foundations of Physics”. Though Weyl mentioned profusely Einstein’s works on general relativity, no mention was made of Hilbert’s paper. Einstein received the proofs page-by-page from the publisher and read them with much delight and was very impressed. However, Einstein, an initial admirer of the beauty of Weyl’s theory, now raised serious objections against Weyl’s field theory. Einstein’s objection to Weyl’s field theory was Weyl’s attempt to unify gravitation and electromagnetism by giving up the invariance of the line element of general relativity. Weyl persistently held to his view for several years and only later finally dropped it.

Einstein also seemed to influence Sir Arthur Stanley Eddington when he objected to what later became known as “black holes”. In his controversy during the Royal Astronomical Society meeting of 1935 with Subrahmanyan Chandrasekhar, Eddington argued that various accidents may intervene to save a star from contracting into a diameter of a few kilometres. This possibility, according to Eddington, was a reductio ad absurdum of the relativistic degeneracy formula. Chandrasekhar later said that gravitational collapse leading to black holes is discernible even to the most casual observer. He, therefore, found it hard to understand why Eddington, who was one of the earliest and staunchest supporters of the general theory of relativity, should have found the conclusion that black holes may form during the natural course of the evolution of stars, so unacceptable. However, it is very reasonable that Eddington, who was one of the earliest and staunchest supporters of Einstein’s classical general relativity, found the conclusion that “black holes” were so unacceptable, because he was probably influenced by Einstein’s objection to the Schwarzschild singularity.

Prof. Jürgen Renn explained in his talk: “We think that the renaissance is also very much a history of a community, in which for the first time a real community of relativists and cosmologists emerged. We have kind of loosely been talked of relativists and cosmologists, even when referring to the twenties and the thirties. This is a somewhat anachronistic use of terms, because the real community only emerged as we see it during the period of the renaissance”.

I would like to comment on the proposal to call the period from 1955 to 1964 the “renaissance” of general relativity. Clearly, in the atmosphere of cinquecento Florence or Milan, a scientist and artist needed a community. Actually for the first time in history, in renaissance Italy there were concentrations of scientists, writers, artists and patrons in close communities and courts. There were communication and interaction between those communities. Historians have reconstructed what went in these communities and how these communities functioned. Hence renaissance is a suitable historical term to describe the period from 1955 to 1964.

Updated July 2016, another talk by Jürgen Renn: the sixth biennial Francis Bacon Conference, “General Relativity at 100”, Bacon Award Public Lecture: (I did not attend this conference but the talk was uploaded to YouTube):

Picture50

In 1907 in the patent office, Einstein was sitting down to write a review article in which he reviewed all the phenomena of physics in order to adapt them to the new framework of space and time established by special relativity. It was a routine task and dealing with gravitation in that context was also a routine task, so it seemed at the beginning.

[My comment: Einstein said in 1933, in the Glasgow lecture: “I came a step closer to the solution of the problem for the first time, when I attempted to treat the law of gravity within the framework of the special theory of relativity.” Apparently, sometime between September 1905 and September 1907 Einstein had already started to deal with the law of gravity within the framework of the special theory of relativity. When did he exactly start his work on the problem? Einstein did not mention any specific date, but in the Glasgow lecture he did describe the stages of his work presumably prior to 1907].

But then Einstein had to deal with the principle that was already established by Galileo hundreds of years ago, namely, the universality of free fall, the fact that all bodies fall with the same acceleration. How can these two be reconciled? When two people, one on the moving train and one on the platform each drop a stone, will the two stones hit the ground simultaneously? According to classical, Newtonian physics yes, but according to special relativity no. That is surprising. Was there any way to impose the universality of free fall and maintain Galileo’s principle?

Picture2a

The following is what inspired Einstein. Later he recalled in 1920: “Then came to me the happiest thought of my life in the following form. In an example worth considering the gravitational field only has a relative existence in a manner similar to the electric field generated by electromagnetic induction. Because for an observer in free-fall from the roof of a house, there is during the fall – at least in his immediate vicinity – no gravitational field”. Now the great thing is that this allowed Einstein to simulate gravity by acceleration and he could now treat accelerated frames of reference with the help of relativity, so he had a handler in the framework of special relativity, but in a new way that preserved universality of free fall. He could now predict that light bends in a gravitational field. The principle of equivalence (elevator experiments – linear acceleration, a heuristic guide).

Where did the idea of a generalization of the special relativity principle to accelerated motion actually come from? Einstein was particularly fascinated by Ernst Mach’s historical critical analysis of mechanics. What could Einstein learn from Mach? Mach had reconsidered Newton’s bucket experiment. Why does the water rise when it stars rotating? Newton’s answer was the following: because it moves with respect to absolute space. Mach’s answer was different: he claimed that it moves because it moves with respect to the fixed stars. That would make it a relative motion, an inertia, an interaction of bodies in relative motion with respect to each other: the water and the stars.

Picture6

Rotation – heuristic guide

Besides Mach’s critique of mechanics, there is another element which can be identified in what Einstein called the happiest thought of his life. Einstein said (1920): “Then came to me the happiest thought of my life in the following form. In an example worth considering the gravitational field only has a relative existence in a manner similar to the electric field generated by electromagnetic induction. Because for an observer in free-fall from the roof of a house, there is during the fall – at least in his immediate vicinity – no gravitational field” (not italicized in the original). Use electromagnetic field theory as a mental model. We can see that it was the analogy of the gravitational field theory with the well-known theory of the electromagnetic field, on which Einstein of course was a specialist, that inspired him to the happiest thought as well, alongside the influence of Mach.

Now with the help of Mach, Einstein was in the position to complete the analogy between electromagnetic theory on the one hand and gravitational theory on the other hand by conceiving gravitation and inertia together as corresponding to the electromagnetic field. This analogy will guide him all these years from 1907 till 1915 to the completion of general relativity.

Let us look at the milestones of the genesis of general relativity. Usually this is portrayed as a drama in three acts:

Picture8

[My comment: John Stachel wrote in his paper “The First Two Acts”, Einstein from B to Z, p. 261, that in 1920 Einstein himself wrote a short list of “my most important scientific ideas” in a letter to Robert Lawson (April 22, 1920):

1907 Basic idea for the general theory of relativity

1912 Recognition of the non-Euclidean nature and its physical determination by gravitation

1915 Field equations of gravitation. Explanation of the perihelion motion of Mercury.

Einstein’s words provide the warrant for comparing the development of general relativity to a three-act drama]:

Picture2

According to Jürgen Renn: The problem here is that this portrait, this drama here leaves out the villain in this story, what is usually considered a villain, namely a theory on which Einstein worked between 1913 and 1915, in Zurich mostly but later also in Berlin, where he discarded it. It is called the preliminary or the draft and in German, the Entwurf theory. Now the point is what for other accounts is the villain of the story, a theory that was discarded, in my account, my book [? not yet published?] is the actual hero.

Picture9

[My comment: I see what Jürgen Renn means, but I don’t think that for other historical accounts the Entwurf theory is a so-called villain of the story, a theory that is discarded in accounts of historians. Jürgen Renn even mentions these historians in his talk – Michel Janssen and John Stachel. What he jokingly calls the “villain”, the Entwurf theory, is a major part of my book, General Relativity Conflict and Rivalries, December 2015 and it is spread over many pages of it].

But let us proceed in order. At the begging of 1911 Einstein became the chair of physics at the German university of Prague, his first full professorship. Parague: What did Einstein achieve in 1912? He knew that the field had to be a combination of gravitation and inertia, but he did not know how to represent it mathematically. Fortunately the problem had two parts: equation of motion – the field tells matter how to move, and field equation – matter tells the field how to behave. He thus first tried to solve the problem of the equation of motion. And in particular the simple case how does a body move when no other forces, other than gravitation and inertia, act on it. Again the analogy with electromagnetism came to his rescue. It made sense that other special cases of dynamic gravitational fields such as the forces acting in a rotating frame of reference… [?] It should be possible to consider such a system at rest and the centrifugal forces acting there as dynamical gravitational forces. That’s what Einstein took from Mach. But the clue is a combination of gravity and inertia. So what could he learn?

Let us look at a rotating disk and try to measure its circumference with little roods. The disk is set into motion. Because of the length contraction predicted by special relativity, the rods would be shrunk, so that we need more of them to cover the circumference. In other words, the ratio between the circumference and the diameter would be larger than pi. This simple thought experiment gave Einstein the idea that, to describe general dynamical gravitational fields one needs to go beyond Euclidean geometry.

Picture11a

Non-Euclidean geometries were known. Einstein himself was not too familiar with non-Euclidean geometries. He had some courses at the ETH, he had skipped some courses at the ETH, but he did know that a straight line in such a geometry corresponds to a straightest line, or a geodesic. That solved for him the problem of the equation of motion, because when no other forces act in such a geometry, a particle would just follow the straightest possible line. Now the program of the new theory was clear. (John A, Wheeler: “matter tells space-time how to curve; curved space-time tells matter how to move”).

In the summer of 1912, Einstein returned to Zurich. He knew that he could describe a curved space-time by the metric tensor. He knew that he could define the deviation of space-time from Euclidean flat geometry in terms of the metric tensor.  A metric tensor is a complicated object:

Picture1

The metric tensor replaces the one Newtonian gravitational potential with ten gravitational potentials. He could even write down the equation of motion in terms of the metric tensor, he achieved that relatively quickly. But he had no clue as how to find a field equation for this complicated object, the metric tensor, these ten gravitational potentials.

One of the most important sources for our story is a notebook in which Einstein entered his calculations, in the winter of 1912-1913, the so-called Zurich Notebook.

The following fraternity of scholars provided historical-critical-mathematical-physical interpretation of the Zurich Notebook (it took them 10 years to interpret Einstein’s calculations):

Einstein scholars

Einstein’s first attempts to deal with the mathematics of the metric tensor look rather pedestrian. He tried to bring together the metric tensor with what he knew about the gravitational field equation, which was also relatively little.

Picture3

When Einstein was desperate he called his old friend Marcel Grossmann: “Grossman you have got to help me or I will go crazy!” Grossman had helped Einstein to survive his exams and he got him his job at the patent office. Now he helped him master the problem of gravitation. Indeed, one immediately recognizes Grossman’s intervention in the notebook. His name appears next to the Riemann tensor, the crucial object for building a relativistic field equation. Einstein immediately used it to form what he considered a candidate to the left hand-side of the field equation.

Picture17

Einstein and Grossmann found that these field equations do not match their physical expectations. It turned out to be difficult to reconcile Einstein’s physical expectations with the new formalism. Groping in the dark, Einstein and Grossmann essentially hit upon the correct field equations, in the winter of 1912-1913, three years before the final paper, in the weak field limit:

Picture19

But Einstein and Grossmann found that these field equations do not match their physical expectations. Eventually they had to learn how to adapt these physical expectations to the implications of the new formalism: we are talking about a learning experience that took place between a mathematical formalism and new physical concepts that were being shaped during the process.

Jürgen Renn then gives the following metaphor [a machine] to explain the mechanism behind a field equation (the Einstein-Grossmann Entwurf gravitational field equation): Einstein started out with a hand made mathematical formalism, at least before Grossmann came into the game, but it did the job. Extracting from the source of the field (mass and energy) a gravitational field. That’s what a field equation is all about. Of course it was most crucial that the familiar special case of Newtonian gravity would also come out in the appropriate circumstances. And Einstein had to make sure that this machine was firmly grounded in basic physical principles and in particular in the conservation of energy and momentum. But he also wanted to generalize the principle of relativity to accelerated motions and he looked for a machine that worked in more general coordinate systems, but at that point he didn’t know quite at which. The later point was unclear to Einstein.

Picture21

The problem was that it was not clear whether that machine would actually deliver the requested physical results. With Grossmann came the dream for a much more sophisticated machine, a machine that worked for all coordinate systems because it was generally covariant:

Picture22

Here the starting point was a sophisticated mathematical formalism based on the Riemann tensor, and then of course the machine had to work in the same way: the source makes a field, but does the Newtonian limit come out right? And is the machine firmly grounded in the principles of energy and momentum conservation? It certainly doesn’t look that quite way. In any way it was generally covariant, working in all coordinate systems. The problem was that it was not entirely clear whether that machine would actually deliver the requested physical results and what kind of tweaking it would take to get them. In short, the mechanism was great but the output was uncertain. Given this situation, Einstein could now peruse two different strategies:

Picture23

*physical requirements: the Newtonian limit and the energy momentum conservation.

In the winter of 1912-1913, Einstein and with him Grossmann constantly oscillated between these two strategies. At the end of the winter he decided for one of them: the physical strategy. Well not quite, but rather a physical strategy tweaked and adapted to match the requirements of energy-momentum conservation and a generalized principle of relativity. So it was a home made extension of the original machine.

[My comment: The “physical strategy” and the “mathematical strategy” and the “oscillation” between them are memorable phraseology of Jürgen Renn. These had already been invented by Jürgen Renn several years ago. You can find it in many papers by Jürgen Renn. For instance Renn, Jürgen and Sauer, Tilman, “Pathways out of Classical Physics”, The Genesis of General Relativity 1, 2007, 113-312].

The result of the collaboration between Einstein and Grossmann in the winter of 1912-1913 was a hybrid theory, the so-called Entwurf or draft theory, the villain or hero mentioned before. Why was the theory, “Draft of a Generalized Theory of Relativity and a Theory of Gravitation” a hybrid theory? It was a hybrid theory because the equation of motion (the field tells matter how to move) is generally covariant (retaining its form in all coordinate systems), but the field equation (matter tells the field how to behave) is not generally covariant. It was not even clear in which coordinate system the field equation would be covariant. Nevertheless, Einstein was quite proud. To his future wife Elsa he wrote: “I finally solved the problem a few weeks ago. It is a bold extension of the theory of relativity together with the theory of gravitation. Now I must give myself some rest, otherwise I will go kaput”. But was it worth the effort? Wasn’t the Entwurf theory just a blind alley and a waste of time (for more than two and a half years)? Most accounts say yes and speak of a comedy of errors.

[My comment: As I mentioned previously, I am afraid I don’t really agree with this conclusion. Other historians don’t say yes. In my account, for instance, in my book General Relativity Conflict and Rivalries, I demonstrate that the Entwurf theory plays a crucial role in Einstein’s development of the November 1915 theory. I refrain, however, from using the terms “bridges”, “scaffolding” and other metaphors Einstein did not use (see below) because I think that, these terms and metaphors embed constraints that impact the understanding of the historical narrative. I rather prefer Einstein’s own terms, for instance, “heuristic guide”. Hence, Einstein was guided by the 1913 calculation of the perihelion of Mercury. So was he guided by the 1914 variational principle, formalism].

But if the Entwurf theory was important, what was its role? What function did it have for the creation of the general theory of relativity, if it turned out to be a wrong theory at the end? To answer that question we shall use another metaphor: the Entwurf theory as a scaffolding for building an arch or a bridge between physics and mathematics (Michel Janssen’s metaphor). The building of a bridge between physics and mathematics. On its basis, Einstein first calculated the Mercury perihelion motion, and working out its mathematical structure, and by “its”, meaning the preliminary Entwurf draft theory. Einstein worked out its mathematical structure and set up a variational formalism for it.

Picture30

The Mercury calculation eventually helped him to solve the problem of the Newtonian limit and the variational formalism helped him to solve the other problem he had encountered with the mathematical strategy, that is, the conservation of energy and momentum. All this prepared the situation of November 1915, when it eventually came to a situation when the scaffolding was torn down.

Picture31

Let us look at the first issue, the issue of the Mercury perihelion motion (a problem studied in detail by Michel Janssen). In 1913 Einstein together with Michele Besso calculated the Mercury perihelion motion on the basis of the Entwurf theory and the value which they miscalculated came out too small.  The theory predicated only 18″per century. This did not shatter, however, Einstein’s confidence in that theory. Einstein never mentioned this unsatisfactory result until 1915 but he reused this method developed under the auspices of the Entwurf theory in November 1915. The method of calculation,  the scaffolding, could be used in the final November theory. The creation of general relativity was a team effort. Besso had a role in the perihelion calculation in building a scaffolding for the transition to the final theory. The Mercury calculation helped Einstein understand the problem of Newtonian limit and accept the field equation he had earlier discarded. The Mercury (perihelion) calculation of 1913 really did act as a scaffolding for what Einstein achieved in November 1915, when he redid this calculation now on the basis of the correct theory.

Einstein’s colleagues were amazed how quickly he could calculate. David Hilbert wrote in a postcard just a day after Einstein had submitted the paper: “Congratulations on conquering the perihelion motion. If I could calculate as fast as you can, the electron would be forced to surrender to my equations and the hydrogen atom would have to bring a note from home to be excused for not radiating”. However, all Einstein had to do is to redo the calculations for the perihelion motion in the Entwurf theory that he had done with Besso in 1913 but never published. Einstein did not bother to tell Hilbert about this earlier work. Apparently he wanted to give Hilbert a dose of his own medicine, seeing Hilbert as somebody who gave the impression of being superhuman by obfuscating his methods (Einstein to Ehrenfest, May 24, 1916).

In November 1915 the building of a scaffolding (Besso’s assistance) helped Einstein to overcome his earlier problems with extracting the Newtonian limit from the field equation found along the mathematical strategy.

But what about the second problem? The conservation laws of energy and momentum? Again the Entwurf theory served as a scaffolding. In 1914 Einstein and Grossmann set up a variational formalism for the Entwurf theory from which it was easy to derive the conservation laws. That formalism was general enough to allow the derivation of the conservation laws also for other theories, including the ones Einstein had discarded in the winter of 1912-1913.  You can use the variational formalism to make a candidate field equation for the physical strategy or you can change the settings, and then you get a different machine, a candidate field equation for the mathematical strategy.

Picture37

Having constructed such a formalism, the variational formalism, is what allowed Einstein to switch from the Entwurf theory to the theory he presented on November 4, 1915.

Einstein had resolved his two major problems that had prevented him in Zurich to accept candidate field equations along the mathematical strategy; namely the requirement to get out the Newtonian limit in the special case and the conservation laws. That confronts us with a puzzle: Why did Einstein not come back to the mathematical strategy right away once he had resolved these problems at the end of 1914?  He firmly believed in the Entwurf theory and had concocted all kinds of arguments in its favor, for instance the hole argument.

[My comment: I am afraid I don’t agree with this conclusion: I don’t think that at the end of 1914 Einstein had already resolved his two major problems (Newtonian limit and conservation laws). He was only able to resolve them in November 1915].

Picture38

But by October 1915, his perspective was gradually changing because problems with the Entwurf theory were gradually accumulated:

1) It did not explain the perihelion problem well, we have seen that. Einstein could live with it. He just put it under the rug and did not mention it in his publications.

2) It did not allow him to conceive rotation at rest. It was a major blow, considering his Machian vision.

3) And, it did not follow uniquely, as he had hoped, from the variational formalism that he had set up. But this failure was actually a blessing in disguise. It meant that the formalism was actually more general and not just tailor-made for the Entwurf theory. So he could use it.

So these problems were the prelude to the drama of November 1915 when Einstein published week after week his four conclusive publications on general relativity. On the 4th of November that is the transition from the Entwurf theory to the new mathematical objects; with an addendum on the 11th of November; the Mercury paper on the 18th of November, and the final field equations on the 25th. The first paper contains an interesting hint at what Einstein considered the “fatal prejudice” that had hindered him so far and also what was the key to the solution. The subsequent papers successively straighten out a logical structure of the theory, show that now the Mercury problem works and the final paper completes the logical structure of the theory.

In order to understand what the fatal prejudice was and what the key to the solution was, we have to once more time look at the mechanism at work here:

Picture40

There is indeed not just the source and the field. There is also the gravitational potential represented by the metric tensor and its connection with the gravitational field. That connection is expressed by a differential operator. One way to express this differential operator turned out to be a fatal prejudice, the other a key to the solution. As it turned out, it was essentially sufficient to change one element in the variational formalism developed for the Entwurf field equations, in order to get the theory from November the 4th, 1915. Namely, redefine the gravitational field.

Here are two ways in which Einstein expressed the connection between the field and the potential: One in the 1913 Entwurf theory and the other in the theory of November 4th. In the paper itself he speaks of the first way as a fatal prejudice and in a letter to Sommerfield he characterizes the second option as the key to the solution:

Picture41

In the end the transition from the Entwurf theory, based on the physical strategy, to the November 1915 theory, based on the sophisticated math of the Riemann tensor, seems to have been a rather simple step. But what made this step possible was the scaffolding represented by the variational formalism Einstein had built for the Entwurf theory.

[My comment: In my book, General Relativity Conflict and Rivalries, I demonstrate an additional element. Einstein wrote to Sommerfeld the following:

Picture4

“scalar derived from the energy tensor of matter, for which I write T in the following”.

Picture1Picture2

In my book I show how one can derive the second term on the right-hand side of the above November 25, 1915 equation on the basis of the variational formalism and on the basis of Einstein’s 1914 Entwurf theory and November 4th, 1915 paper. I connect between this latter derivation and the derivation of the November 4, 1915 field equation from the 1914 variation principle].

A variational formalism is a machine for making machines: It made it simpler to pass from a machine based on the fatal prejudice:

Picture42

to a machine that represented the key to the solution:

Picture43

Einstein had to revise the architecture of his theory step by step and that is what happened in the final publication of November 1915. To Arnold Sommerfeld he wrote: “unfortunately I have immortalized my final errors in the academy papers” (November 28, 1915). And to his friend Paul Ehrenfest he wrote: “It is convenient with that fellow Einstein: every year he retracts what he wrote the year before” (December 26, 1915).

In Einstein’s defense one had to remember that what contributed to the drama was that the mathematical David Hilbert was or at least seemed to have been hot on Einstein’s trail. Hilbert presented his field equations in Göttingen on November 20, 1915, five days before Einstein. He used the Riemann curvature scalar in his variational formalism. He did not explicitly write down the field equation but he could have easily calculated it of course. In the late 1990s, page proofs of Hilbert paper, which itself was not published until March 1916, turned up. These page proofs carry a date of December 6, 1915, after Einstein’s publication.

Picture46

Picture47

Did Hilbert beat Einstein to the punch? His page proofs show that the original version of Hilbert’s theory was conceptually closer to the Entwurf theory than to Einstein’s final version. Hilbert’s theory of December 6, 1915 was just as the Entwurf theory, a hybrid theory with extra conditions on the coordinate systems. This restriction on the coordinate systems was later dropped in the published version appearing in March 1916. Hence, the moral is: Einstein could have taken his time in November 1915 and need not have worried about Hilbert stealing his thunder. Hilbert did not build a bridge between mathematics and physics as Einstein had done. In fact he didn’t worry about these problems of Newtonian limit and energy momentum conservation in the way that Einstein had done. So on November 25, 1915, the edifice of general relativity seemed complete.

This is the first part of Jürgen Renn’s lecture, it deals with the genesis of general relativity (until approximately 49 minutes after the YouTube video start time). The second part of the lecture, not given here, is quite disappointing compared to the first part. In the first part of the lecture, Jürgen Renn is inspired by great scholars, notably John Stachel. Unfortunately, the second part of the lecture lacks the inspiration and sensation of the greatness of the fraternity of Einstein scholars (see photo further above).

 

 

 

 

 

My new book on Einstein and the history of the general theory of relativity

Here is the dust jacket of my new scholarly book on the history of general relativity, to be released on… my Birthday:

General Relativity Conflict and Rivalries: Einstein’s polemics with Physicists.

Cover

The book is illustrated by me and discusses the history of general relativity, gravitational waves, relativistic cosmology and unified field theory between 1905 and 1955:

The development of general relativity (1905-1916), “low water mark” period and several results during the “renaissance of general relativity” (1960-1980).

Ein

Conversations I have had more than a decade ago with my PhD supervisor, the late Prof. Mara Beller (from the Hebrew University in Jerusalem), comprise major parts of the preface and the general setting of the book. However, the book presents the current state of research and many new findings in history of general relativity.

Ein2

My first book:

Einstein’s Pathway to the Special Theory of Relativity (April, 2015)

includes a wide variety of topics including also the early history of general relativity.

Einstein2

Review of Arch and Scaffold Physics Today

Arch and scaffold: How Einstein found his field equations” by Michel Janssen and Jürgen Renn. Physics Today 68(11), 30 (2015). The article is published in November 2015, which marks the centenary of the Einstein field equations. (Renn co-authored with Gutfreund The Road to Relativity, Princeton Press)

This is a very good article. However, I would like to comment on several historical interpretations. . Michel Janssen and Jürgen Renn ask: Why did Einstein reject the field equations of the first November paper (scholars call them the “November tensor”) when he and Marcel Grossmann first considered them in 1912–13 in the Zurich notebook?

They offer the following explanation: In 1912 Albert Einstein gave up the November tensor (derived from the Ricci tensor) because the rotation metric (metric of Minkowski spacetime in rotating coordinates) did not satisfy the Hertz restriction (the vanishing of the four-divergence of the metric). Einstein wanted the rotation metric to be a solution of the field equations in the absence of matter (vacuum field equations) so that he could interpret the inertial forces in a rotating frame of reference as gravitational forces (i.e. so that the equivalence principle would be fulfilled in his theory).

However, the above question – why did Einstein reject the November tensor in 1912-1913, only to come back to it in November 1915 – apparently has several answers. It also seems that the answer is Einstein’s inability to properly take the Newtonian limit.

Einstein’s 1912 earlier work on static gravitational fields (in Prague) led him to conclude that in the weak-field approximation, the spatial metric of a static gravitational field must be flat. This statement appears to have led him to reject the Ricci tensor, and fall into the trap of Entwurf limited generally covariant field equations. Or as Einstein later put it, he abandoned the generally covariant field equations with heavy heart and began to search for non-generally covariant field equations. Einstein thought that the Ricci tensor should reduce in the limit to his static gravitational field theory from 1912 and then to the Newtonian limit, if the static spatial metric is flat. This prevented the Ricci tensor from representing the gravitational potential of any distribution of matter, static or otherwise. Later in the 1920s, it was demonstrated that the spatial metric can go to a flat Newtonian limit, while the Newtonian connection remains non-flat without violating the compatibility conditions between metric and (affine) connection (See John Stachel).

PT_3_2979_figures_online_f1

Phys. Today 68, 11, 30 (2015).

As to the “archs and scaffolds” metaphor. Michel Janssen and Jürgen Renn demonstrate that the Lagrangian for the Entwurf field equations has the same structure as the Lagrangian for the source-free Maxwell equations: It is essentially the square of the gravitational field, defined as minus the gradient of the metric. Since the metric plays the role of the gravitational potential in the theory, it was only natural to define the gravitational field as minus its gradient. This is part of the Entwurf scaffold. The authors emphasize the analogy between gravity and electromagnetism, on which Einstein relied so heavily in his work on the Entwurf theory.

However, I am not sure whether in 1912-1913 Einstein was absolutely aware of this formal analogy when developing the Entwurf field equations. He first found the Entwurf equations, starting from energy-momentum considerations, and then this analogy (regarding the Lagrangian) lent support to his Entwurf field equations. Anyway, I don’t think that this metaphor (analogy between gravity and electromagnetism) persisted beyond 1914. Of course Einstein came back to electrodynamics-gravity, but I think that he discovered his 1915 field equations in a way which is unrelated to Maxwell’s equations (apart from the 1911 generally covariant field equations, influenced by Hilbert’s electromagnetic-gravitational unified theory, but this is out of the scope of this post and of course unrelated to the above metaphor).

Einstein

As to the November 4, 1915 field equations of Einstein’s general theory of relativity: When all was done after November 25, 1915, Albert Einstein said that the redefinition of the components of the gravitational field in terms of Christoffel symbols had been the “key to the solution”. Michel Janssen and Jürgen Renn demonstrate that if the components of the gravitational field – the Christoffel symbols – are inserted into the 1914 Entwurf Lagrangian, then the resulting field equations (using variational principle) are the November tensor. In their account, then, Einstein found his way back to the equations of the first November paper (November 4, 1915) through considerations of physics. Hence this is the interpretation to Einstein’s above “key to the solution”.

I agree that Einstein found his way back to the equations of the first November paper through considerations of physics and not through considerations of mathematics. Mathematics would later serve as heuristic guide in searching for the equations of his unified field theory. However, it seems to me that Michel Janssen and Jürgen Renn actually iterate Einstein’s November 4, 1915 variational method. In November 4, 1915, Einstein inserted the Christoffel symbols into his 1914 Entwurf Lagrangian and obtained the November 4, 1915 field equations (the November tensor). See explanation in my book, General Relativity Conflict and Rivalries, pp. 139-140.

Indeed Janssen and Renn write: There is no conclusive evidence to determine which came first, the redefinition of the gravitational field (in terms of the Christoffel symbols) or the return to the Riemann tensor.

Hence, in October 1915 Einstein could have first returned to the November tensor in his Zurich Notebook (restricted to unimodular transformations) and only afterwards in November 1915, could he redefine the gravitational field components in terms of the Christoffel symbols. Subsequently, this led him to a redefinition of the Entwurf Lagrangian and, by variational method, to a re-derivation of the 1912 November tensor.

9481ad94bd

Van Gogh had nostrified Hilbert (Hilbert visited Van Gogh, closed time-like loops…. ….)

Finally, Michel Janssen and Jürgen Renn write: Despite Einstein’s efforts to hide the Entwurf scaffold, the arch unveiled in the first November paper (November 4, 1915) still shows clear traces of it.

I don’t think that Einstein tried to hide the Entwurf scaffold. Although later he wrote Arnold Sommerfeld: “Unfortunately, I have immortalized the last error in this struggle in the Academy-papers, which I can send to you soon”, in his first November paper Einstein had explicitly demonstrated equations exchange between 1914 Entwurf and new covariant November ones, restricted to unimodular transformations.

Stay tuned for my book release, forthcoming soon (out by the end of 2015) on the history of general relativity, relativistic cosmology and unified field theory between 1907 and 1955.