book_cover_big.gifI have in previous blogs explained a little bit about what entropy is and its relationship with the amount of heat exchanged. We have also seen that Clausius discovered that in isolated systems the entropy always increases and that the there is no way that we can reduce the entropy of a given isolated system. Also we saw that an increase in entropy points towards a degradation of the quality of energy such that low quality (=high entropy) energy can no longer be applied to convert it into work.

So far this has been a more or less a phenomenological description of what entropy is. You can compare this with the observation that every time you toss up a stone it will fall back to earth. So if you make a law of gravity that says that a bodies will always fall back to earth then that law is probably very accurate but it does not add to your understanding of what gravity really is! We are in a similar situation with Clausius definition of entropy, we still do not understand what entropy is. This changed when around 1900 Ludwig Boltzmann[1], an Austrian scientist, started to think about what entropy actually was.

Around 1900 there was still a fierce debate going on between scientists whether atoms really existed or not. Boltzmann was convinced that they existed and realized that models that relied on atoms and molecules and their energy distribution and their speed and momentum, could be of great help to understand physical phenomena. Because atoms where supposed to be very small, even in relatively small systems one faces already a tremendous number of atoms. For example: one mililiter of water contains about 3×10²² molecules! Clearly it is impossible to track of each individual atom things like energy and velocity. Boltzmann introduced therefore a mathematical treatment using statistical mechanical methods to describe the properties of a given physical system (for example the relationship between temperature, pressure and volume of one liter of air). Boltzmann’s idea behind statistical mechanics was to describe the properties of matter from the mechanical properties of atoms or molecules. In doing so, he was finally able to derive the Second Law of Thermodynamics around 1890 and showed the relationship between the atomic properties and the value of the entropy for a given system. It was Max Planck who based on Boltzmann results formulated of what was later called Boltzmann expression:

S = k lnW

Here is S the entropy, k is Boltzmann constant, ln is the natural logarithm and W is the amount of realization possibilities the system has. This last sentence typically encounters some problems when we try to understand this. The value of W is basically a measure of how likely a system can exist given certain characteristics. Let me give an example. Imagine you have a deck of cards with 4 identical cards. The deck as a total can be described with parameters such as the number of cards, thickness of the deck, weight and so on. With four cards we have 4x3x2x1 = 24 possible configurations that all lead to the same (in terms of the parameters above) deck of cards. Therefore in this case W = 24.  The Boltzmann constant, k, equals to 1.4 10-²³ J/K and the entropy S is then kln24 = 4.4 10 -²³ J/K. The more possibilities a given system has to establish itself (and with the many atoms we have in one gram of material there are many possibilities!) the more likely it will be that we will indeed observe that system and the higher the entropy will be.

Now it is easier to understand the observation of Clausius that the entropy increases all the time. This is because a given (isolated) system will tend to become more disordered and thus more likely to occur. Unfortunately the more disorder a given system has the less useful such a system is from a human perspective. Energy is much more useful when it is captured in a liter of fuel than when that same amount of energy, after we burned the fuel, is distributed all over the environment! Clearly the entropy went up because the disorder after burning increased.    

Copyright © 2007 John E.J. Schmitz

Ludwig Boltzmann was born in 1844 in Vienna. He was a theoretical physicist who worked in various locations: Graz, Heidelberg, Berlin, Vienna. In 1902 he was teaching mathematical physics and philosophy in Vienna for which he became very famous. His statistical mechanical theory received a lot of criticism from his peers such as Wilhelm Ostwald. Because of these continuous attacks and his depressions he committed suicide in 1906 in Trieste (Italy). On his tomb one can find the famous formula S = k log W.