Elementary Principles in Statistical Mechanics/Chapter XV

From Wikisource
Jump to navigation Jump to search
1542038Elementary Principles in Statistical MechanicsChapter XV. Systems composed of molecules.Josiah Willard Gibbs

CHAPTER XV.

SYSTEMS COMPOSED OF MOLECULES.

The nature of material bodies is such, that especial interest attaches to the dynamics of systems composed of a great number of entirely similar particles, or, it may be, of a great number of particles of several kinds, all of each kind being entirely similar to each other. We shall therefore proceed to consider systems composed of such particles, whether in great numbers or otherwise, and especially to consider the statistical equilibrium of ensembles of such systems. One of the variations to be considered in regard to such systems is a variation in the numbers of the particles of the various kinds which it contains, and the question of statistical equilibrium between two ensembles of such systems relates in part to the tendencies of the various kinds of particles to pass from the one to the other.

First of all, we must define precisely what is meant by statistical equilibrium of such an ensemble of systems. The essence of statistical equilibrium is the permanence of the number of systems which fall within any given limits with respect to phase. We have therefore to define how the term "phase" is to be understood in such cases. If two phases differ only in that certain entirely similar particles have changed places with one another, are they to be regarded as identical or different phases? If the particles are regarded as indistinguishable, it seems in accordance with the spirit of the statistical method to regard the phases as identical. In fact, it might be urged that in such an ensemble of systems as we are considering no identity is possible between the particles of different systems except that of qualities, and if particles of one system are described as entirely similar to one another and to of another system, nothing remains on which to base the indentification of any particular particle of the first system with any particular particle of the second. And this would be true, if the ensemble of systems had a simultaneous objective existence. But it hardly applies to the creations of the imagination. In the cases which we have been considering, and in those which we shall consider, it is not only possible to conceive of the motion of an ensemble of similar systems simply as possible cases of the motion of a single system, but it is actually in large measure for the sake of representing more clearly the possible cases of the motion of a single system that we use the conception of an ensemble of systems. The perfect similarity of several particles of a system will not in the least interfere with the identification of a particular particle in one case with a particular particle in another. The question is one to be decided in accordance with the requirements of practical convenience in the discussion of the problems with which we are engaged.

Our present purpose will often require us to use the terms phase, density-in-phase, statistical equilibrium, and other connected terms on the supposition that phases are not altered by the exchange of places between similar particles. Some of the most important questions with which we are concerned have reference to phases thus defined. We shall call them phases determined by generic definitions, or briefly, generic phases. But we shall also be obliged to discuss phases defined by the narrower definition (so that exchange of position between similar particles is regarded as changing the phase), which will be called phases determined by specific definitions, or briefly, specific phases. For the analytical description of a specific phase is more simple than that of a generic phase. And it is a more simple matter to make a multiple integral extend over all possible specific phases than to make one extend without repetition over all possible generic phases.

It is evident that if , are the numbers of the different kinds of molecules in any system, the number of specific phases embraced in one generic phase is represented by the continued product and the coefficient of probability of a generic phase is the sum of the probability-coefficients of the specific phases which it represents. When these are equal among themselves, the probability-coefficient of the generic phase is equal to that of the specific phase multiplied by . It is also evident that statistical equilibrium may subsist with respect to generic phases without statistical equilibrium with respect to specific phases, but not vice versa.

Similar questions arise where one particle is capable of several equivalent positions. Does the change from one of these positions to another change the phase? It would be most natural and logical to make it affect the specific phase, but not the generic. The number of specific phases contained in a generic phase would then be , where denote the numbers of equivalent positions belonging to the several kinds of particles. The case in which a is infinite would then require especial attention. It does not appear that the resulting complications in the formulae would be compensated by any real advantage. The reason of this is that in problems of real interest equivalent positions of a particle will always be equally probable. In this respect, equivalent positions of the same particle are entirely unlike the different ways in which particles may be distributed in different positions. Let it therefore be understood that in spite of the physical equivalence of different positions of the same particle they are to be considered as constituting a difference of generic phase as well as of specific. The number of specific phases contained in a generic phase is therefore always given by the product .

Instead of considering, as in the preceding chapters, ensembles of systems differing only in phase, we shall now suppose that the systems constituting an ensemble are composed of particles of various kinds, and that they differ not only in phase but also in the numbers of these particles which they contain. The external coördinates of all the systems in the ensemble are supposed, as heretofore, to have the same value, and when they vary, to vary together. For distinction, we may call such an ensemble a grand ensemble, and one in which the systems differ only in phase a petit ensemble. A grand ensemble is therefore composed of a multitude of petit ensembles. The ensembles which we have hitherto discussed are petit ensembles.

Let , etc., denote the numbers of the different kinds of particles in a system, its energy, and , its coördinates and momenta. If the particles are of the nature of material points, the number of coördinates () of the system will be equal to . But if the particles are less simple in their nature, if they are to be treated as rigid solids, the orientation of which must be regarded, or if they consist each of several atoms, so as to have more than three degrees of freedom, the number of coördinates of the system will be equal to the sum of , , etc., multiplied each by the number of degrees of freedom of the kind of particle to which it relates.

Let us consider an ensemble in which the number of systems having particles of the several kinds, and having values of their coördinates and momenta lying between the limits and , and , etc., is represented by the expression

(4998)
where , , , are constants, denoting the total number of systems in the ensemble. The expression
(499)
evidently represents the density-in-phase of the ensemble within the limits described, that is, for a phase specifically defined. The expression
(500)
is therefore the probability-coefficient for a phase specifically defined. This has evidently the same value for all the phases obtained by interchanging the phases of particles of the same kind. The probability-coefficient for a generic phase will be times as great, viz.,
(501)

We shall say that such an ensemble as has been described is canonically distributed, and shall call the constant its modulus. It is evidently what we have called a grand ensemble. The petit ensembles of which it is composed are canonically distributed, according to the definitions of Chapter IV, since the expression

(502)
is constant for each petit ensemble. The grand ensemble, therefore, is in statistical equilibrium with respect to specific phases.

If an ensemble, whether grand or petit, is identical so far as generic phases are concerned with one canonically distributed, we shall say that its distribution is canonical with respect to generic phases. Such an ensemble is evidently in statistical equilibrium with respect to generic phases, although it may not be so with respect to specific phases.

If we write for the index of probability of a generic phase in a grand ensemble, we have for the case of canonical distribution

(503)
It will be observed that the is a linear function of and ; also that whenever the index of probability of generic phases in a grand ensemble is a linear function of , , the ensemble is canonically distributed with respect to generic phases.

The constant we may regard as determined by the equation

(504)
or
(505)
where the multiple sum indicated by includes all terms obtained by giving to each of the symbols all integral values from zero upward, and the multiple integral (which is to be evaluated separately for each term of the multiple sum) is to be extended over all the (specific) phases of the system having the specified numbers of particles of the various kinds. The multiple integral in the last equation is what we have represented by . See equation (92). We may therefore write
(506)

It should be observed that the summation includes a term in which all the symbols have the value zero. We must therefore recognize in a certain sense a system consisting of no particles, which, although a barren subject of study in itself, cannot well be excluded as a particular case of a system of a variable number of particles. In this case is constant, and there are no integrations to be performed. We have therefore[1]

The value of is of course zero in this case. But the value of contains an arbitrary constant, which is generally determined by considerations of convenience, so that and do not necessarily vanish with .

Unless has a finite value, our formulae become illusory. We have already, in considering petit ensembles canonically distributed, found it necessary to exclude cases in which has not a finite value.[2] The same exclusion would here make finite for any finite values of . This does not necessarily make a multiple series of the form (506) finite. We may observe, however, that if for all values of

(507)
where are constants or functions of ,
i. e.,
i. e.,
i. e.,
(508)
The value of will therefore be finite, when the condition (507) is satisfied. If therefore we assume that is finite, we do not appear to exclude any cases which are analogous to those of nature.[3]

The interest of the ensemble which has been described lies in the fact that it may be in statistical equilbrium, both in respect to exchange of energy and exchange of particles, with other grand ensembles canonically distributed and having the same values of and of the coefficients , , etc., when the circumstances are such that exchange of energy and of particles are possible, and when equilibrium would not subsist, were it not for equal values of these constants in the two ensembles.

With respect to the exchange of energy, the case is exactly the same as that of the petit ensembles considered in Chapter IV, and needs no especial discussion. The question of exchange of particles is to a certain extent analogous, and may be treated in a somewhat similar manner. Let us suppose that we have two grand ensembles canonically distributed with respect to specific phases, with the same value of the modulus and of the coefficients , and let us consider the ensemble of all the systems obtained by combining each system of the first ensemble with each of the second.

The probability-coefficient of a generic phase in the first ensemble may be expressed by

(509)
The probability-coefficient of a specific phase will then be expressed by
(510)
since each generic phase comprises specific phases. In the second ensemble the probability-coefficients of the generic and specific phases will be
(511)
and
(512)

The probability-coefficient of a generic phase in the third ensemble, which consists of systems obtained by regarding each system of the first ensemble combined with each of the second as forming a system, will be the product of the probability-coefficients of the generic phases of the systems combined, and will therefore be represented by the formula

(513)
where , , , etc. It will be observed that , etc., represent the numbers of particles of the various kinds in the third ensemble, and its energy; also that is a constant. The third ensemble is therefore canonically distributed with respect to generic phases.

If all the systems in the same generic phase in the third ensemble were equably distributed among the specific phases which are comprised in the generic phase, the probability-coefficient of a specific phase would be

(514)
In fact, however, the probability-coefficient of any specific phase which occurs in the third ensemble is
(515)
which we get by multiplying the probability-coefficients of specific phases in the first and second ensembles. The difference between the formulae (514) and (515) is due to the fact that the generic phases to which (513) relates include not only the specific phases occurring in the third ensemble and having the probability-coefficient (515), but also all the specific phases obtained from these by interchange of similar particles between two combined systems. Of these the probability-coefficient is evidently zero, as they do not occur in the ensemble.

Now this third ensemble is in statistical equilibrium, with respect both to specific and generic phases, since the ensembles from which it is formed are so. This statistical equilibrium is not dependent on the equality of the modulus and the co-efficients in the first and second ensembles. It depends only on the fact that the two original ensembles were separately in statistical equilibrium, and that there is no interaction between them, the combining of the two ensembles to form a third being purely nominal, and involving no physical connection. This independence of the systems, determined physically by forces which prevent particles from passing from one system to the other, or coming within range of each other's action, is represented mathematically by infinite values of the energy for particles in a space dividing the systems. Such a space may be called a diaphragm.

If we now suppose that, when we combine the systems of the two original ensembles, the forces are so modified that the energy is no longer infinite for particles in all the space forming the diaphragm, but is diminished in a part of this space, so that it is possible for particles to pass from one system to the other, this will involve a change in the function which represents the energy of the combined systems, and the equation will no longer hold. Now if the co-efficient of probability in the third ensemble were represented by (513) with this new function , we should have statistical equilibrium, with respect to generic phases, although not to specific. But this need involve only a trifling change in the distribution of the third ensemble,[4] a change represented by the addition of comparatively few systems in which the transference of particles is taking place to the immense number obtained by combining the two original ensembles. The difference between the ensemble which would be in statistical equilibrium, and that obtained by combining the two original ensembles may be diminished without limit, while it is still possible for particles to pass from one system to another. In this sense we may say that the ensemble formed by combining the two given ensembles may still be regarded as in a state of (approximate) statistical equilibrium with respect to generic phases, when it has been made possible for particles to pass between the systems combined, and when statistical equilibrium for specific phases has therefore entirely ceased to exist, and when the equilibrium for generic phases would also have entirely ceased to exist, if the given ensembles had not been canonically distributed, with respect to generic phases, with the same values of and .

It is evident also that considerations of this kind will apply separately to the several kinds of particles. We may diminish the energy in the space forming the diaphragm for one kind of particle and not for another. This is the mathematical expression for a "semipermeable" diaphragm. The condition necessary for statistical equilibrium where the diaphragm is permeable only to particles to which the suffix relates will be fulfilled when and have the same values in the two ensembles, although the other coefficients , etc., may be different.

This important property of grand ensembles with canonical distribution will supply the motive for a more particular examination of the nature of such ensembles, and especially of the comparative numbers of systems in the several petit ensembles which make up a grand ensemble, and of the average values in the grand ensemble of some of the most important quantities, and of the average squares of the deviations from these average values.

The probability that a system taken at random from a grand ensemble canonically distributed will have exactly particles of the various kinds is expressed by the multiple integral

(516)
or
(517)
This may be called the probability of the petit ensemble . The sum of all such probabilities is evidently unity. That is,
(518)
which agrees with (506).

The average value in the grand ensemble of any quantity , is given by the formula

(519)
If is a function of alone, i. e., if it has the same value in all systems of any same petit ensemble, the formula reduces to
(520)
Again, if we write and to distinguish averages in the grand and petit ensembles, we shall have
(521)

In this chapter, in which we are treating of grand ensembles, will always denote the average for a grand ensemble. In the preceding chapters, has always denoted the average for a petit ensemble.

Equation (505), which we repeat in a slightly different form, viz.,

(522)
shows that is a function of and ; also of the external coördinates , , etc., which are involved implicitly in . If we differentiate the equation regarding all these quantities as variable, we have
(523)
If we multiply this equation by , and set as usual , , etc., for , , etc., we get in virtue of the law expressed by equation (519),
(524)
that is,
(525)
Since equation (503) gives
(526)
the preceding equation may be written
(527)
Again, equation (526) gives
(528)
Eliminating from these equations, we get
(529)
If we set
(530)
(531)
we have
(532)

The corresponding thermodynamic equations are

(533)
(534)
(535)
These are derived from the thermodynamic equations (114) and (117) by the addition of the terms necessary to take account of variation in the quantities (, , etc.) of the several substances of which a body is composed. The correspondence of the equations is most perfect when the component substances are measured in such units that , , etc., are proportional to the numbers of the different kinds of molecules or atoms. The quantities , , etc., in these thermodynamic equations may be defined as differential coefficients by either of the equations in which they occur.[5]

If we compare the statistical equations (529) and (532) with (114) and (112), which are given in Chapter IV, and discussed in Chapter XIV, as analogues of thermodynamic equations, we find considerable difference. Beside the terms corresponding to the additional terms in the thermodynamic equations of this chapter, and beside the fact that the averages are taken in a grand ensemble in one case and in a petit in the other, the analogues of entropy, and , are quite different in definition and value. We shall return to this point after we have determined the order of magnitude of the usual anomalies of .

If we differentiate equation (518) with respect to , and multiply by , we get

(536)
whence , which agrees with (527). Differentiating again with respect to , and to , and setting
we get
(537)
(538)
The first members of these equations represent the average values of the quantities in the principal parentheses. We have therefore
(539)
(540)

From equation (539) we may get an idea of the order of magnitude of the divergences of from its average value in the ensemble, when that average value is great. The equation may be written

(541)
The second member of this equation will in general be small when is great. Large values are not necessarily excluded, but they must be confined within very small limits with respect to . For if
(542)
for all values of between the limits and , we shall have between the same limits
(543)
and therefore
(544)
The difference is therefore numerically a very small quantity. To form an idea of the importance of such a difference, we should observe that in formula (498) is multiplied by and the product subtracted from the energy. A very small difference in the value of may therefore be important. But since is always less than the kinetic energy of the system, our formula shows that , even when multiplied by or , may still be regarded as an insensible quantity.

We can now perceive the leading characteristics with respect to properties sensible to human faculties of such an ensemble as we are considering (a grand ensemble canonically distributed), when the average numbers of particles of the various kinds are of the same order of magnitude as the number of molecules in the bodies which are the subject of physical experiment. Although the ensemble contains systems having the widest possible variations in respect to the numbers of the particles which they contain, these variations are practically contained within such narrow limits as to be insensible, except for particular values of the constants of the ensemble. This exception corresponds precisely to the case of nature, when certain thermodynamic quantities corresponding to , , , etc., which in general determine the separate densities of various components of a body, have certain values which make these densities indeterminate, in other words, when the conditions are such as determine coexistent phases of matter. Except in the case of these particular values, the grand ensemble would not differ to human faculties of perception from a petit ensemble, viz., any one of the petit ensembles which it contains in which , , etc., do not sensibly differ from their average values.

Let us now compare the quantities and , the average values of which (in a grand and a petit ensemble respectively) we have seen to correspond to entropy. Since

and
(545)
A part of this difference is due to the fact that relates to generic phases and to specific. If we write for the index of probability for generic phases in a petit ensemble, we have
(546)
(547)
(548)
This is the logarithm of the probability of the petit ensemble ().[6] If we set
(549)
which corresponds to the equation
(550)
we have
and
(551)
This will have a maximum when[7]
(552)

Distinguishing values corresponding to this maximum by accents, we have approximately, when are of the same order of magnitude as the numbers of molecules in ordinary bodies,

(553)
(554)
where
(555)
and
(556)
This is the probability of the system (). The probabilty that the values of lie within given limits is given by the multiple integral
(557)

This shows that the distribution of the grand ensemble with respect to the values of follows the "law of errors" when are very great. The value of this integral for the limits should be unity. This gives

(558)
or
(559)
where
(560)
that is,
(561)

Now, by (553), we have for the first approximation

(562)
and if we divide by the constant ,[8] to reduce these quantities to the usual unit of entropy,
(563)
This is evidently a negligible quantity, since is of the same order of magnitude as the number of molecules in ordinary bodies. It is to be observed that is here the average in the grand ensemble, whereas the quantity which we wish to compare with is the average in a petit ensemble. But as we have seen that in the case considered the grand ensemble would appear to human observation as a petit ensemble, this distinction may be neglected.

The differences therefore, in the case considered, between the quantities which may be represented by the notations[9]

are not sensible to human faculties. The difference
and is therefore constant, so long as the numbers are constant. For constant values of these numbers, therefore, it is immaterial whether we use the average of or of for entropy, since this only affects the arbitrary constant of integration which is added to entropy. But when the numbers are varied, it is no longer possible to use the index for specific phases. For the principle that the entropy of any body has an arbitrary additive constant is subject to limitation, when different quantities of the same substance are concerned. In this case, the constant being determined for one quantity of a substance, is thereby determined for all quantities of the same substance.

To fix our ideas, let us suppose that we have two identical fluid masses in contiguous chambers. The entropy of the whole is equal to the sum of the entropies of the parts, and double that of one part. Suppose a valve is now opened, making a communication between the chambers. We do not regard this as making any change in the entropy, although the masses of gas or liquid diffuse into one another, and al-though the same process of diffusion would increase the entropy, if the masses of fluid were different. It is evident, therefore, that it is equilibrium with respect to generic phases, and not with respect to specific, with which we have to do in the evaluation of entropy, and therefore, that we must use the average of or of , and not that of , as the equivalent of entropy, except in the thermodynamics of bodies in which the number of molecules of the various kinds is constant.


  1. This conclusion may appear a little strained. The original definition of may not be regarded as fairly applying to systems of no degrees of freedom. We may therefore prefer to regard these equations as defining in this case.
  2. See Chapter IV, page 35.
  3. If the external coördinates determine a certain volume within which the system is confined, the contrary of (507) would imply that we could obtain an infinite amount of work by crowding an infinite quantity of matter into a finite volume.
  4. It will be observed that, so far as the distribution is concerned, very large and infinite values of (for certain phases) amount to nearly the same thing,—one representing the total and the other the nearly total exclusion of the phases in question. An infinite change, therefore, in the value of (for certain phases) may represent a vanishing change in the distribution.
  5. Compare Transactions Connecticut Academy, Vol. III, pages 116 ff.
  6. See formula (517).
  7. Strictly speaking, is not determined as function of , except for integral values of these variables. Yet we may suppose it to be determined as a continuous function by any suitable process of interpolation.
  8. See page 184-186.
  9. In this paragraph, for greater distinctness, and have been written for the quantities which elsewhere are denoted by and .