text:
# Nonlocal mixing of supercurrents in Josephson ballistic point contact

## Abstract

We study coherent current states in the mesoscopic superconducting weak link simultaneously subjected to the order parameter phase difference $`\varphi `$ on the contact and to the tangential to the junction interface superfluid velocity $`𝐯_s`$ in the banks. The Josephson current-phase relation $`I_J(\varphi )`$ controlled by the external transport current $`I_T(𝐯_s)`$ is obtained. At $`\varphi `$ close to $`\pi `$ the nonlocal nature of the Josephson phase-dependent current results in the appearance of two vortexlike states in the vicinity of the contact.

The superfluid flow of Cooper pairs in superconductor is related to the space dependence of the phase $`\chi `$ of the order parameter. In (quasi)homogeneous current state the supercurrent density $`𝐣`$ locally depends on the superfluid velocity $`𝐯_s=\frac{\mathrm{}}{2m}\chi (𝐫)`$. Such a state is realized in narrow films or wires . In the case when the phase $`\chi `$ strongly varies in the scale of superconducting coherence length $`\xi _0`$ the relation between the current density $`𝐣(𝐫)`$ and $`\chi (𝐫)`$ becomes nonlocal. This situation (opposite to the homogeneous current state) is realized in Josephson weak links (for review see ), e.g. in superconducting point contacts - microconstrictions between two bulk superconductors (banks). The Josephson current nonlocally depends on $`\chi (𝐫)`$ and is determined (parameterized) by the total phase difference $`\varphi `$ across the weak link. The current-phase relation $`𝐣(\varphi )`$ for ballistic point contact was obtained in . The nonlocal nature of Josephson current in mesoscopic junctions was demonstrated by Heida et. al.  and studied in theoretical papers .

The Josephson weak link could be considered as a ”mixer” of two superconducting macroscopic quantum states in the banks. The result of the mixing is the phase dependent current carrying state with current flowing from one bank to another. The properties of this state depend on the properties of the states of the banks. For example, in Josephson junction between unconventional ($`d`$-wave) superconductors the surface current, tangential to the contact interface, appears simultaneously with Josephson current (see e.g. ).

In this paper we study coherent current states in the Josephson weak link between conventional superconductors, whose banks are in the homogeneous current states. The questions raised in our consideration are the following ones: How two superconducting current carrying states in the banks are coherently mixed by a mesoscopic Josephson junction, or in other words, what is a result of the interplay between transport current $`j_T(𝐯_s)`$ flowing parallel to the junction interface and nonlocal Josephson current $`j_J(\varphi )`$? How the Josephson properties of the system are influenced by the external controlling transport current? We have found that the distribution of the current in a region of nonlocal mixing strongly depends on the global phase difference $`\varphi `$ between banks and for $`\varphi =\pi `$ contains the vortexlike states. The current-phase relation $`j_J(\varphi )`$ at $`\varphi `$ near $`\pi `$ essentially depends on the superfluid velocity in the banks $`𝐯_s`$, in particular, the absolute value of the derivative $`dj_J/d\varphi `$ at $`\varphi =\pi `$ is suppressed by the transport current.

We consider the Josephson weak link with direct conductivity - a microbridge between thin superconducting films. The bridge sizes, length $`L`$ and width $`2a`$, are assumed to be smaller than the coherence length $`\xi _0`$. In this case even for temperature $`T`$ near the critical temperature $`T_c`$ the local description based on the Ginzburg-Landau approach is not applicable. To describe the coherent current states in the system we use the quasiclassical Eilenberger equations, which are valid for temperatures $`0<T<T_c`$ and for arbitrary relation between the contact size and coherence length $`\xi _0`$. On the other hand, we assume that $`a`$ and $`L`$ are much larger than the Fermi wavelength $`\lambda _F`$. The electron mean free path is supposed to be much larger than $`\xi _0`$.

Suppose the homogeneous transport current $`I_T`$ with a superfluid velocity $`𝐯_s`$ flows in the banks of the contact. The situation with controlled phase difference $`\varphi `$ and preset current $`I_T`$ may be realized if the microbridge is incorporated in a cylindrical thin film (Fig 1). Let the radius of the cylinder be less than London penetration depth and larger than the coherence length. In this case the phase difference $`\varphi `$ is governed by the external magnetic flux $`\mathrm{\Phi },`$ $`\varphi =\frac{2e}{\mathrm{}c}\mathrm{\Phi },`$ and the external transport current $`I_T`$ flowing along the cylinder is homogeneously distributed far from the microconstriction.

The Eilenberger equations for the $`\xi `$-integrated Green’s functions have the form :

$$𝐯_F\frac{}{𝐫}\widehat{G}_\omega (𝐯_F,𝐫)+[\omega \widehat{\tau }_3+\widehat{\mathrm{\Delta }}(𝐯_F,𝐫),\widehat{G}_\omega (𝐯_F,𝐫)]=0,$$
(1)
where

$$\widehat{\mathrm{\Delta }}=\left(\begin{array}{cc}0& \mathrm{\Delta }\\ \mathrm{\Delta }^{}& 0\end{array}\right),\widehat{G}_\omega (𝐯_F,𝐫)=\left(\begin{array}{cc}g_\omega & f_\omega \\ f_\omega ^{}& g_\omega \end{array}\right);$$
(2)
$`\widehat{\tau }_3`$ is the Pauli matrix, $`\mathrm{\Delta }`$ is the superconducting order parameter, and $`\widehat{G}_\omega (𝐯_F,𝐫)`$ is the matrix Green’s function, which depends on the electron velocity on the Fermi surface $`𝐯_F`$, the coordinate $`𝐫`$, and the Matsubara frequency $`\omega =(2n+1)\pi T`$, with $`n`$ being an integer number.

The order parameter $`\mathrm{\Delta }`$ is determined by the self-consistency equation

$$\mathrm{\Delta }(𝐫)=\pi \lambda T\underset{\omega }{}f_\omega (𝐯_F,𝐫)_{𝐯_F}.$$
(3)
Solution of the matrix equation (1) together with Eq.(3) determines the current density $`𝐣(𝐫)`$ in the system

$$𝐣(𝐫)=2\pi ieN(0)T\underset{\omega }{}𝐯_Fg_\omega (𝐯_F,𝐫)_{𝐯_F}.$$
(4)
Here $`\lambda `$ is the BCS coupling constant, $`N(0)`$ is the density of states at the Fermi surface, $`\mathrm{}_{𝐯_F}`$ is the averaging over directions of the velocity $`𝐯_F`$.

If the film thickness $`w`$ is much smaller than $`\xi _0,`$ the spatial distributions of $`\mathrm{\Delta }(𝐫)`$ and $`𝐣(𝐫)`$ depend only on coordinates in the plane of the film and the Eilenberger equations (1) reduce to the two-dimensional ones. We solve these equations in the model of the microbridge as a slit in thin impenetrable partition ($`L=0`$) at $`x=0`$ between two half-planes $`x0`$ (Fig. 2). The equations (1) for Green’s function $`\widehat{G}_\omega (𝐯_F,x,y)`$ have to be supplemented by the continuity condition at the slit $`\left(x=0,\left|y\right|<a\right)`$ and by the condition of the specular reflection at the line $`(x=0,\left|y\right|a)`$. Far from the constriction the Green’s functions must satisfy to the conditions, which describe the homogeneous current parallel to the $`y`$axis.

As it was shown in  in the zero approximation on the small parameter $`a/\xi _01`$ for a self-consistent calculation of the superconducting current it is not necessary to find the spatial dependence $`\mathrm{\Delta }(x,y)`$. In the same approximation the superfluid velocity $`𝐯_s`$ does not depend on coordinates. The spatial variation of $`\mathrm{\Delta }`$ and $`𝐯_s`$ is essential at the distances $`\rho `$ from the contact $`\rho a`$. The Green’s functions are varied at the distances of order $`\xi _0`$ and in the main approximation on the parameter $`a/\xi _01`$ they are defined by the values of $`\mathrm{\Delta }\left(𝐯_s\right)`$ and $`𝐯_s`$ in the banks of the contact. For $`\mathrm{\Delta }`$ and $`𝐯_s`$ being constants at each half-plane an analytical solution of Eilenberger equations can be found by the method of integration along quasiclassical trajectories. Under the condition $`a/\xi _01`$ such solution is selfconsistent. In any point $`\rho =(x,y)`$ all ballistic trajectories can be classified as transit trajectories (marked by ”$`1`$” at Fig.2), for which $`𝐯_F`$ $`\alpha (\rho )`$ ($`\alpha (\rho )`$ being the angle at which the slit is seen from the point $`\rho `$) and non-transit trajectories, $`𝐯_F`$ $`\alpha (\rho )`$, (marked by ”$`2`$” at Fig. 2). For transit trajectories the Green’s functions satisfy the boundary conditions in the both banks. For the non-transit trajectories they satisfy to specular reflection condition at the partition and the conditions in the left or right bank. Making use of the solution of Eilenberger equations, we obtain the following expression for the current density (4) at the slit:

$$𝐣(x=0,\left|y\right|<a,\varphi ,𝐯_s)=$$
(5)
$$4\pi \left|e\right|N(0)v_FT\underset{\omega >0}{}\widehat{𝐯}Im\frac{i\mathrm{\Omega }\mathrm{sin}\frac{\varphi }{2}\eta \stackrel{~}{\omega }\mathrm{cos}\frac{\varphi }{2}}{\eta \mathrm{\Omega }\mathrm{cos}\frac{\varphi }{2}i\stackrel{~}{\omega }\mathrm{sin}\frac{\varphi }{2}}_{\widehat{𝐯}},$$
(6)
where $`\mathrm{\Omega }=\sqrt{\stackrel{~}{\omega }^2+\mathrm{\Delta }^2}`$, $`\stackrel{~}{\omega }=\omega +i𝐩_F𝐯_s`$, $`\widehat{𝐯}=𝐯_F/v_F`$ is the unit vector, $`\eta =sign(v_x)`$. We should require $`Re\mathrm{\Omega }>0,`$ which fixes the sign of the square root to be $`sign(𝐩_F𝐯_s)`$. Under the condition $`a/\xi _01`$ the current density at the slit does not depend on the $`y`$coordinate, and the total current through the contact (Josephson current) is equal to $`I_J=2awj_x(x=0,\left|y\right|<a,\varphi ,𝐯_s)`$.

For $`𝐯_s=0`$ the component of the current (5) tangential to the contact $`j_y0`$ and for the Josephson current density $`j_Jj_x`$ we have the result obtained in the paper . In general case $`𝐯_s0`$ the current (5) has both $`j_J`$ and $`j_y`$ components. The tangential current $`j_y`$ depends on the phase $`\varphi `$ and is not equal to the transport current density $`𝐣_T`$ in the banks. In particular, at $`\varphi `$ near $`\pi `$ it goes in opposite direction to the external transport current (see below).

To describe the influence of the transport current in the banks on the Josephson current we introduce the dimensionless parameter $`q=v_sp_F/\mathrm{\Delta }_0`$ $`\left(\mathrm{\Delta }_0=\mathrm{\Delta }(T=0,v_s=0)\right).`$ The value of $`q`$ is varied in the range $`0<q<q_c`$. The critical value $`q_c`$ corresponds to the critical current density in the homogeneous current state. At zero temperature $`q_c=1`$, and the gap $`\mathrm{\Delta }`$ does not depend on $`q`$ . In Fig.3 we plot the Josephson current $`I_J(\varphi )`$ at temperature $`T=0.1T_c`$ for different values of $`q`$. The presence of the tangential transport current in the banks suppresses the value of the critical Josephson current and essentially changes the derivative $`dI_J/d\varphi `$ at $`\varphi =\pi `$. We emphasize, that the dependence of the Josephson current $`I_J`$ $`\left(\varphi \right)`$ on $`q,`$ which is shown in Fig.3, does not relate to the suppression of the gap by the transport current, which is negligible for such low temperatures.

The derivative $`dI_J/d\varphi `$ at $`\varphi =\pi `$ determines the kinetic inductance of Josephson junction , which is relevant, e.g., for SQUID’s operation. The expression for the derivative of the Josephson current $`I_J`$at $`\varphi =\pi `$ has the form

$$\frac{dI_J}{d\varphi }|_{\varphi =\pi }=2aw\frac{|e|N(0)\mathrm{\Delta }^2}{mv_s}f\left(\frac{v_sp_F}{\pi T}\right),$$
(7)
where function $`f(x)`$ is plotted in Fig.4. The derivative $`dI_J/d\varphi (\varphi =\pi )`$ is inversely proportional to $`v_s`$ at $`Tp_Fv_s`$ and it is inversely proportional to $`T`$ at $`Tp_Fv_s`$.

By using the Green’s functions along transit and non-transit trajectories, calculated in the main approximation on the small parameter $`a/\xi _0`$, we can find the spatial distributions of the order parameter and the current density in the contact (see Ref.). The numerically calculated current density distributions for different values of phase $`\varphi `$ and the temperature $`T=0.1T_c`$ are shown in Figures 5 and 6. For small values of the phase difference $`\varphi `$ between banks, the current density $`𝐣(\rho )`$ is just the vector sum of the homogeneous transport current density in the banks $`𝐣_T(𝐯_s)`$ and the conventional Josephson current $`𝐣_J(\varphi ,\rho ,𝐯_s=0)`$ (Fig.5). For $`\varphi `$ near $`\pi `$ the constructive interference of supercurrents takes place. At $`\varphi =\pi `$ there are no Josephson current, $`j_J=0,`$ and the current is distributed in the way that there are two antisymmetric ”vortices” close to the contact region (Fig.6). Far from the constriction (at the distances $`\rho \xi _0a`$) the interference current is spread out and the current density is equal to its value in the banks.

Simple and transparent expression for the current density distribution $`𝐣(\rho )`$ can be found for temperatures close to the critical temperature ($`T_cTT_c`$). At the distances from the contact, which are less than the coherence length $`\xi _0`$ and arbitrary in comparison with the size $`a`$, $`𝐣(\rho )`$ takes the form:

$$𝐣(\rho ,\varphi ,𝐯_𝐬)=𝐣_J(\rho ,\varphi )+𝐣_T(𝐯_s)+𝐣_{JT}(\rho ,\varphi ,𝐯_s);$$
(8)
$$𝐣_J(\rho ,\varphi )=2j_c\mathrm{sin}\varphi \widehat{𝐯}sign(v_x)_{\widehat{𝐯}\alpha (\rho )};$$
(9)
$$𝐣_T(𝐯_s)=j_ck\widehat{𝐯}\widehat{v}_y_{\widehat{𝐯}};$$
(10)
$$𝐣_{JT}(\rho ,\varphi ,𝐯_s)=j_ck(1\mathrm{cos}\varphi )\widehat{𝐯}\widehat{v}_y_{\widehat{𝐯}\alpha (\rho )},$$
(11)
where

$$j_c(T,v_s)=\frac{\pi |e|N(0)v_F}{8}\frac{\mathrm{\Delta }^2(T,v_s)}{T_c}$$
(12)
is a critical current density of the contact at $`TT_c`$, $`k=(14\varsigma (3)/\pi ^3)(v_sp_F/T_c)`$. We detach explicitly the Josephson current $`𝐣_J(\rho ,\varphi )`$, and the spatially homogeneous (transport) current density $`𝐣_T(𝐯_s)`$ produced by the superfluid velocity $`𝐯_s`$, and write the total current (8) as the sum of three components: $`𝐣_J`$, $`𝐣_T`$, and the rest - the ”interference” current $`𝐣_{JT}`$. The macroscopic quantum interference takes place in the vicinity of the contact region where both coherent current densities $`𝐣_J(\rho ,\varphi )`$ and $`𝐣_T(𝐯_s)`$ exist. We emphasize, that at $`\varphi `$ near $`\pi `$ at the slit the ”interference” current $`𝐣_{JT}`$ is antiparallel to $`𝐣_T.`$ If the phase difference $`\varphi =\pi ,`$ the current $`𝐣_{JT}=2𝐣_T`$. When there is no phase difference (at $`\varphi =0)`$, we have $`𝐣_{JT}=0`$.

In conclusion, we have investigated the coherent current states in the Josephson ballistic point contact simultaneously subjected to the order parameter phase difference $`\varphi `$ and to the tangential to the junction interface the superfluid velocity $`v_s`$ in the banks. The current-phase relation $`I_J(\varphi )`$ is shown to be controlled by the transport superconducting current $`I_T(𝐯_s)`$. Thus, varying $`I_T(𝐯_s)`$, the characteristics of the weak link, such as the shape of the Josephson current-phase relation and the value of the critical current, can be changed. The similar effect can be produced by the increasing of the temperature $`T`$ of the system. But, as compared to the controlling by the transport supercurrent, the increasing of the temperature leads to additional thermal noise.

Moreover, the current distribution pattern in the vicinity of the contact was obtained. The current pattern drastically depends on the external phase difference $`\varphi `$; in particular, at $`\varphi =\pi `$ the existence of two antisymmetric vortexlike current structures is predicted. Considering the current pattern, we have also demonstrated that the superposition of the supercurrents in the vicinity of the weak link is not just their vector sum. These results can be relevant in a wide range of problems, in which the current (and corresponding magnetic field) distribution in the vicinity of the weak link is important.

We thank I.Dmitrenko, I.Yanson, A.Zagoskin and A.Amin for stimulating discussions. We acknowledge support from D-Wave Sys.Inc.(Vancouver).


format: text

text:
# Modification of the valence band electronic structure under Ag intercalation underneath graphite monolayer on Ni(111)

## I Introduction

The continuing interest in carbon-based material has resulted in a number of studies of their magnetic, electronic, and transport properties which are interesting from technological as well as fundamental point of view . The ability to alter the properties of graphite and graphite intercalation compounds (GICs) makes them interesting candidates for a range of applications including, for example, magnetic storage, hard coating, and optical devices. Also, quasi-two-dimensional or even one-dimensional character of mentioned structures gives the opportunity to use them as model systems for different studies in solid-state physics and chemistry.

In the last decades the systems on the basis of noble metals (Cu, Au, Ag) intercalated underneath a monolayer of graphite (MG) on top of Ni(111) were extensively investigated by means of high-resolution-electron-energy-loss-spectroscopy (HREELS)  and photoemission spectroscopy (PES)  methods. These systems have attracted a strong interest due to a quasi two-dimensional geometric and electronic structure. In these noble metal intercalation-like systems an unusual effect of energetic shift of graphite-derived branches in the valence band electronic structure and the phonon vibration spectra after intercalation of noble metals were observed. This effect is caused by the weakening of the ”MG-substrate” interaction due to the noble metal intercalation. From the other side, this intercalation-like system on the basis of MG and noble metal can be chosen as a possible way of formation of a flat layered structure, in spite of the case of noble metal deposition on pure Ni(111) surface, where the formation of three-dimensional island-like structures was observed. In particular, in work  the formation of flat pseudomorphic copper layer on top of Ni(111) was possible by using a benzene as surfacant with subsequent removing of benzene from the surface after intercalation process.

In this paper the investigations of the valence band electronic structure modification upon Ag intercalation underneath MG located on top of the Ni(111) by angle-resolved photoemission spectroscopy (ARPES) are presented. This work is a continuation of HREELS-investigations of this system . In spite of our previous PES investigations of the analogous systems on the basis of copper and gold as intercalant , in the current work, the attention was attracted to the changes in the graphite-derived electronic structure as well as to estimation of amount of intercalated Ag as a dependence of the annealing temperature as well as of the amount of deposited Ag on top of MG/Ni(111) system.

The present investigations show that the most appropriate temperature for intercalation of Ag atoms underneath MG on Ni(111) is in the range between 350 and 400-450 C. Above these temperatures the partial system degradation was observed. As a result of Ag atoms intercalation at 350-450 C the energetic shift of the graphite-derived valence band states was observed. In this case these branches are located at lower binding energies in comparison with the MG/Ni(111) system that can be explained by the weakening of the ”MG-substrate” interaction after Ag intercalation underneath MG.

As it was mentioned above one of the present work tasks was determination of the intercalated amount of Ag underneath MG on top of Ni(111). In the recent works  the process of Ag atoms intercalation underneath MG on Ir(111) textured foil was investigated. Auger electron spectroscopy (AES) and thermo-desorption spectroscopy (TDS) investigations showed that maximal amount of Ag which can be intercalated underneath MG is one monolayer (ML) in contrast to the Ag concentration deposited on top of MG. Earlier in our previous work  the assumption about intercalation of only 1 ML of Ag underneath MG and that the rest of deposited Ag formed a large 3D islands on top of MG/Ni(111) system was made.

To make this problem clear in the present work the AES experiments for three different amount of pre-deposited Ag (3, 10 and 100 Å) were performed. For estimation of Ag intercalated amount the mean free path of AES electrons should be taken into account. In this case for careful analysis of the intercalation process the high kinetic energy (Ekin) AES lines of elements were chosen. As a result of AES investigations the amount of Ag intercalated underneath MG was estimated to about 2 ML independently on thickness of pre-deposited amount of Ag (3-100 Å). This value is very small in comparison to the amount of Ag deposited on the sample surface before the intercalation. In this case the formation of large 3D islands of non-intercalated Ag is expected.

## II Experimental details

The experiments were carried out in two separated UHV experimental chambers equipped with low energy electron diffraction (LEED) and AES optics, an ion gun and a gas inlet system. Angle-resolved photoemission measurements were carried out with ADES-type spectrometer at the Berliner Electronenspeicherring für Synchrotronstrahlung (BESSY I, Berlin, Germany) using a monochromatic light with the photon energy of 50 eV from TGM2 beamline. Total energy resolution was 100 meV and angle resolution was 1. The AES experiments were carried out by four-grid electron spectrometer with relative energy resolution of 0.25%. All spectra were collected in $`dN/dE`$ mode with energy of primary electron beam of 1000 eV and modulation voltage of 2 V. The base pressure in the experimental chambers was better than 1$`\times `$10-10 mbar.

MG was formed on top of the Ni(111) surface by cracking of propylene (C3H6) at surface temperature of 500C using the recipe described in details in . Sample exposition at a propylene pressure of 1$`\times `$10-6 mbar during 4 min was enough to form a well ordered MG layer on top of Ni(111) surface. The crystallographic structure was checked by LEED and ordered hexagonal LEED picture with three-fold symmetry was observed . Ag films were deposited at room temperature from melted Ag piece (purity 99.9%) supported by W wire which was heated by current and thickness of the deposited layer was simultaneously measured by water-cooled quartz microbalance monitor. The processes of Ag intercalation underneath MG on top of Ni(111) surface was investigated at a substrate temperature in the range between 350 and 500 C. Same sample preparation procedure of the intercalation-like system on the basis of Ag and MG was described earlier in our work  for HREELS investigations of the phonon structure of MG/Ag/Ni(111) system.

## III Experimental results and discussion

In Fig.1 a series of the normal emission valence band photoemission spectra is presented for ”as-deposited” 100 Å-thick Ag-overlayer on top of the MG/Ni(111) system as well as after annealing of the (Ag + MG/Ni(111)) system at different temperatures in the range between 350 and 500 C. These temperature regimes are appropriated for Ag-intercalation in accordance with our previous HREELS investigations . For comparison, the corresponding spectrum for the initial MG/Ni(111) system is shown by open symbols.

PES spectrum for the MG/Ni(111) system is characterized by pronounced $`\pi _{1v}`$ and $`\sigma _{2,3v}`$ graphite-derived features located at the binding energies (BE) of about 10.2 and 5 eV, respectively, and two Ni 3d-derived features with maxima at 0.5 and 1.4 eV BE. Room-temperature deposition of 100 Å Ag leads to suppression of MG- and Ni-derived states in the PES spectra. The dominant features in the spectra are Ag 4d-derived states located in the BE range between 4 and 7 eV. Despite a significant amount of deposited Ag (about of 100 Å) the weaked Ni 3d states at the BE of 0.5 and 1.5 eV and very weak $`\pi _{1v}`$ graphite-derived features at about of 10 eV can be distinguished in the spectra that can testify an island-like character of ”as-deposited” Ag-layer. Additional feature observed at the Fermi-level (EF) can be related to the surface states characterized for metallic silver .

Annealing of the 100 Å Ag/MG/Ni(111) system at 350 C is followed by the restoring of the $`\pi _{1v}`$ graphite-derived states and disappearing of the Ni 3d states in the energy region between EF and 1.5 eV BE. In comparison with the initial MG/Ni(111) system the $`\pi _{1v}`$ graphite-derived states are shifted towards lower BE by of 1.3 eV up to of about 9 eV BE. The Ag 4d-derived features remain dominant ones in the PES spectra. Increase of annealing temperature up to 400 and 450 C leads to further decreasing of the BE of $`\pi _{1v}`$-derived states. After annealing at 450 C the BE of the $`\pi _{1v}`$ graphite-derived states reaches the value of about 8.3 eV relative to EF. Further increase of annealing temperature up to 500 C is followed by reverse increasing of the BE of the $`\pi _{1v}`$-derived states. The structure of the Ag 4d-derived states does not changed at these annealing temperatures. The restoring of the intensity of $`\pi _{1v}`$ graphite-derived states and the decreasing of their BE after annealing of the Ag/MG/Ni(111) system at temperatures above than 350 C can be explained by the intercalation of Ag atoms underneath MG on top of Ni(111) and the change of the ”MG-substrate” interaction after intercalation.

In Fig.2 the changes of the relative intensities of the $`\pi _{1v}`$ graphite-derived states at 10.2 eV BE and the Ag 4d-derived feature located at 4.5 eV BE are presented for the annealed system at different temperatures in comparison with those for the MG/Ni(111) system and for the ”as-deposited” Ag overlayer on top of MG/Ni(111) system. It can be seen that annealing at 350 C leads to a growth of the intensity of the $`\pi _{1v}`$ graphite-derived feature and suppression of the intensity of the Ag 4d-derived one. Increase of the annealing temperature up to 400 and 450 C leads to the further increasing of the intensity of the $`\pi _{1v}`$ graphite-derived states and suppression of the Ag 4d-derived states. However, annealing at temperature of 500 C is followed by the decreasing of intensity of the $`\pi _{1v}`$ graphite-derived states as well as by the increasing of the Ag 4d-derived ones.

On the basis of the presented data (changes of the BEs and of the intensity of the graphite- and Ag 4d-derived states) the optimal temperature for the Ag-intercalation in the range between 350 and 450 C was found. At higher annealing temperature leads to the start of the MG/Ag/Ni(111) system degradation process was observed.

In order to estimate the quantity of intercalated Ag underneath MG on top of the Ni(111) surface the AES experiments were carried out. Three different thicknesses of Ag were used (3, 10 and 100 Å). The AES intensities of the C(KVV), Ag(M5N45N45), Ni(L3M45M45) and Ni (MVV) lines with Ekin=272, 351, 848, and 60 eV respectively, depending on annealing temperature for the case of 100 Å of pre-deposited Ag on top of MG/Ni(111) system are shown in Fig.3a. The choice of these lines for quantitative analysis was caused by the possibility to carefully separate the contributions from different elements (C, Ag and Ni) and by the reason that the electrons with such kinetic energy have a larger mean free path than electrons with Ekin around 50 eV analysed in PES experiments. Encircled numbers I and II in Fig.3a correspond to MG/Ni(111) system and system after deposition of corresponding amount of Ag on top of MG, respectively. After Ag deposition the intensities of the C and Ni AES peaks decreased and Ag AES peak increased. After annealing of the Ag/MG/Ni(111) system the situation is changed: intensity of the Ag AES peak is decreased and intensities of the carbon and Ni peaks are increased. At annealing temperature of about 300 C the intensity of carbon peak is the same as for the MG/Ni(111) system. In this case the situation is following: the graphite layer is on the top of the system and Ag intercalation underneath MG on top of Ni(111) takes place. In the same time the Ni AES peak has a visible intensity at least three times smaller in comparison with the MG/Ni(111) system.

For comparison, the changes of the intensity ratio of the Ni and Ag AES peaks with temperature change are presented in Fig.3b and marked by solid squares, circles and triangles for 3, 10 and 100 Å of pre-deposited Ag, respectively. For systems with 3 and 10 Å of pre-deposited Ag on top of the MG/Ni(111) the behaviours of the AES spectra with changes of annealing temperature are the same (not shown here): decreasing of the intensity of the carbon and Ni AES peaks after deposition of Ag and increasing ones after annealing at temperatures above 250 C. For all three cases the intensity of the carbon AES peak for the system, which is produced by the annealing of the Ag/MG/Ni(111) system at 350-370 C, is nearly the same and has an intensity comparable with intensity of carbon AES peak for the MG/Ni(111) system. In all cases the Ni AES peaks were also observed. From the analysis of the Fig.3a and 3b the main features can be pointed: (i) intensity of the Ni AES peak for the case of 100 Å pre-deposited Ag after annealing procedure is two times smaller than for the case of 3 Å pre-deposited Ag, where intercalation of 1 ML of Ag was supposed, (ii) for the system with 100 Å of pre-deposited Ag the intensity of the Ni AES peak after annealing is decreased by three times in comparison with MG/Ni(111) system, (iii) for all three systems the Ni AES peak with kinetic energy of 60 eV is clearly visible (this peak has a small inelastic mean free path in comparison with other AES peaks). On the basis of this analysis one can conclude that for all three cases of pre-deposited Ag on top of MG/Ni(111) system, only about 2 ML of Ag can be intercalated underneath MG on top of Ni(111) independently on thickness of pre-deposited Ag film. This conclusion is in a good agreement with results of works  where the thickness of intercalated Ag was estimated as 1 ML, but near some imperfections of the surface of the Ni crystal (as a defects, steps, dislocations etc.) the intercalations of two or more monolayers of Ag can be expected.

For analysis of the peaks intensities extracted from PES data the mean free path of photoelectrons at $`h\nu `$=50 eV has to be taken into account. From these estimations of the intensity changes of Ni 3d states near EF one can conclude that 2-3 MLs of covered layer on top of Ni(111) (together with MG) should be enough to completely depress the intensity of these states near EF. These estimations together with presented AES data lead to a conclusion that in case of Ag intercalation underneath MG only 1-2 monolayers of Ag are intercalated underneath MG matrix. The rest of Ag can decorate the defects at the surface and form a randomly-situated large 3D-islands as a lot of dislocations were observed by STM on MG surface as it was shown in previous investigations of copper intercalations underneath MG . The next possibility is the agglomeration of Ag at the borders of the sample. This estimation can be compared with the results of work . In case of Au the 1 ML intercalation underneath MG on top of Ni(111) the Ni 3d states near EF were also fully depressed. In opposite, for Cu intercalation the Ni 3d states still can be distinguished. Such diferences in the Ni 3d states behaviour for the noble metal intercalation underneath MG on Ni(111) can be explained by the nickel-copper alloy formation and absence of such alloys for Au and Ag at temperatures essential for noble metal intercalation.

In Fig.4 a series of angle-resolved PES spectra for the MG/Ag/Ni(111) system formed by annealing of 100Å Ag+MG/Ni(111) system at 450 C are presented. Spectra were measured in $`\overline{\mathrm{\Gamma }}`$-$`\overline{K}`$ direction of the graphite surface Brillouin zone (SBZ). Corresponding dispersions of the main valence band graphite-derived electronic states are shown in Fig.5 for the systems formed by annealing at temperatures of 350, 400 and 450 C. Also in Fig.5 the dispersion in $`\overline{\mathrm{\Gamma }}`$-$`\overline{M}`$ direction for the MG/Ag/Ni(111) system with the 3 Å and 4.7 Å of the pre-deposited Ag is shown by open squares and circles, respectively. The measurements in this case were made with the He resonance lamp and photon energy was 40.8 eV. Here, for comparison the dispersion of the $`\pi `$ and $`\sigma `$ graphite-derived states for the MG/Ni(111) system as well as for pristine graphite are shown by straight and dash-dotted lines, respectively. Similar to Fig.1 the PES spectra presented in Fig.4 are characterized by dominant contribution of the Ag 4d-derived features. The fine structure of the Ag 4d-derived states practically do not changed with the polar angle variation. These states are practically non-dispersive in the PES spectra. Besides the Ag 4d-derived structure the PES spectra are characterized by the $`\pi _{1v}`$, $`\sigma _{1v}`$ and $`\sigma _{2,3v}`$ graphite-derived states with strong dispersion. Binding energy of the $`\sigma _{1v}`$ and $`\pi _{1v}`$ states in the $`\overline{\mathrm{\Gamma }}`$ point of the SBZ (normal emission) are equal to 21.5 and 8.3 eV, respectively. By increase of the polar angle the $`\pi _{1v}`$-states reach the position with the BEs lower than those for the Ag 4d-derived states. For polar angles over 25 ($`k_{||}>`$1.4-1.5 Å-1) the $`\pi `$-states are splited in two features. One feature reaches the BE of about 3 eV for $`k_{||}`$1.5 Å-1. Second feature has the lowest BE equals of about 1 eV for the polar angles in the region of 30 ($`k_{||}=`$1.7 Å-1) that corresponds to the $`\overline{K}`$ point of graphite SBZ. By further increase of polar angle both states show decreasing intensities and shift towards higher BEs. Besides the $`\pi _{1v}`$ and $`\sigma _{1v}`$ graphite-derived states, the $`\sigma _{2,3v}`$ graphite-derived states can be distinguished in the PES spectra for polar angles over 20(Fig.5). These states are also strongly dispersive. Dispersive dependencies for these states are presented in Fig.5. In comparison with the dispersion dependencies of the MG/Ni(111) system the branch of the $`\pi _{1v}`$ graphite-derived states is significantly shifted as whole towards lower BEs by about of 1.5-2 eV after intercalation of Ag atoms underneath MG on Ni(111). In the $`\overline{K}`$ point of the graphite SBZ the BE of the $`\pi _{1v}`$ states for the MG/Ag/Ni(111) system is about of 1 eV in comparison with the BE about of 3 eV for the MG/Ni(111) system. Totally the $`\pi _{1v}`$ states for the MG/Ag/Ni(111) system are located in the region between branches characteristic for pristine graphite and for the MG/Ni(111) system. In the region of the $`\overline{K}`$ point they are located more close to the positions characteristic for pristine graphite. The $`\sigma _{1v}`$ states in the region of the $`\overline{\mathrm{\Gamma }}`$ point are located at the energy characteristic for pristine graphite. In the region of the $`\overline{K}`$ point these states have the BE about of 16.5 eV. This energetic shift of the graphite-derived valence band states for the MG/Ni(111) system can be attributed to weakening of the interaction of MG with Ni-substrate after intercalation of Ag atoms. In accordance to  this interaction for the MG/Ni(111) system is caused by orbital mixing (hybridization) of the $`\pi `$-states of MG with 3d-states of the substrate. Such hybridization is followed by electron redistribution from the bonding $`\pi `$-states to antibonding $`\pi ^{}`$-states that results in the weakening of the (C-C) bonds in the graphite layer and increase of the BE of the graphite-derived states (different for the $`\sigma `$ and $`\pi `$ states). Intercalation of Ag atoms increases the distance between MG and Ni-substrate and, as consequence, leads to decreasing of the MG $`\pi `$ \- Ni 3d interaction and to significantly lower BEs of the $`\pi `$ and $`\sigma `$ graphite-derived states as compared to those in the MG/Ni(111) system. The assumption about the weakening of the ”MG-substrate” interaction after Ag-intercalation is in agreement with the results of HREELS investigations of the MG/Ag/Ni(111) system  which displays the analogous effect of ”stiffening” of the graphite-derived phonon modes after Ag-intercalation.

In some degree analogous energetic shift of the graphite-derived states were recently observed upon intercalation of gold and copper underneath MG on the Ni(111) . But in that case the $`\pi `$ and $`\sigma `$ graphite-derived states were shifted upon Cu or Au intercalation up to the positions characteristic for pristine graphite. Such difference between modification of the PE spectra upon intercalation of Ag, Cu and Au can be explained by more complex interaction of Ag with MG and Ni-substrate. According to results of Oshima et al. calculations of the phonon modes in the MG/Cu/Ni and MG/Ag/Ni systems the interaction of MG with substrate after intercalation of Ag is more stronger than that, which realizes in the case of pristine graphite and the Mg/Cu/Ni(111) system .

On the basis of these experimental observations the following model can be proposed: after intercalation of Ag in the MG/Ni(111) system the covalent-like nature of interaction between MG and substrate is saving due to the (Ni - Ag) interaction. However, the strength of this interaction is lower than in the case of the MG/Ni(111) system. This assumption is supported by the experimental fact, which shows that the occupation of the $`\pi ^{}`$ graphite-derived states and the appearance corresponding features in the PES spectra were not observed. This situation is opposite to the case of the alkali metal intercalation underneath MG where these effects were observed .

Other interesting effect observed after the Ag-intercalation is the splitting of the $`\pi `$ graphite-derived states in the PES spectra for polar angles over 25 ($`k_{||}>`$1.4 Å-1). In our opinion the observed difference in the energetic positions and the angle dependencies of both $`\pi `$ grahite-derived branches maxima can be related to different behavior of the $`\pi `$ states in the regions of the $`\overline{K}`$ and $`\overline{M}`$-point of the graphite SBZ. On this basis one can assume that the second branch of the $`\pi `$ states with maximum of the BE at 4 eV at $`k_{||}`$1.4 Å-1 is similar to the behavior of the $`\pi `$ states in the region of the $`\overline{M}`$-point of the SBZ, i.e. it can be the ”footprint” of the $`\overline{\mathrm{\Gamma }}\overline{M}`$ direction (see, for comparison, the real dispersion in $`\overline{\mathrm{\Gamma }}\overline{M}`$ direction shown by open symbols). It can be caused by some domains disorientation in graphite monolayer which can arrive after Ag atoms intercalation. The BE value of the $`\sigma _{1v}`$-states observed in the region of the $`\overline{K}`$-point of the SBZ can be also understood from analogous positions. This part of the $`\sigma _{1v}`$ graphite-derived branch can be also related to ”footprint” of the $`\sigma _{1v}`$ states in the $`\overline{\mathrm{\Gamma }}\overline{M}`$ direction. The LEED pattern of the system after Ag atoms intercalation displays graphite-like (1$`\times `$1) hexagonal structure characteristic for the MG/Ni(111) system with some weak strips rotated on 15 with respect to hexagonal ones. Such LEED patterns suggest that the prepared system is terminated by graphite-like domains with some orientation misfit with respect to the Ni(111) substrate, as it has been already observed for the MG/Cu/Ni(111) system  and has been described for the MG/Ag/Ni(111) system . This disorientation is ordered one that leads to equivalent electronic structure both in the $`\overline{\mathrm{\Gamma }}\overline{K}`$ and $`\overline{\mathrm{\Gamma }}\overline{M}`$ directions of the monocrystalline graphite SBZ. From the other side the splitting of the $`\pi `$ graphite-derived states for the MG/Ni(111) system around $`\overline{K}`$-point of the graphite SBZ was theoretically predicted by Souzu et al. The energy dispersion of the $`\pi `$ graphite-derived states along the high-symmetry line $`\overline{\mathrm{\Gamma }}\overline{K}\overline{M}`$ has a splitting-point at around of 2 eV BE. But for the isolated graphene layer which can be taken as an ideal case in the model of MG/Ag/Ni(111) intercalation-like system this splitting-point lies at EF . The possible energy shift can be caused by the rest interaction MG with substrate and deviation from the ideal model of isolated graphene layer.

## IV Conclusion

On the basis of the PES and AES investigations of the Ag intercalation process underneath MG on top of the Ni(111) surface the following conclusions can be made: (i) optimal temperature for intercalation of Ag underneath MG lies in the range 350-450 C; at temperature above 500 C the degradation of the MG/Ag/Ni(111) system starts; (ii) the valence band electronic structure of the MG/Ag/Ni(111) system is characterized by the energetic shift of the $`\pi `$ and $`\sigma `$ graphite-derived states as compared with the MG/Ni(111) system towards lower BEs by about of 1.5-2 eV and 0.5-1 eV, respectively; it is assumed that the observed changes of electronic structure is caused by the weakening of the $`\pi `$-d interaction of the MG with substrate; the ”orbital mixing” nature of this interaction is saving after Ag intercalation; (iii) on the basis of intensity changes analysis of C, Ag and Ni AES peaks in intercalation process a conclusion about 1-2 ML of intercalated Ag underneath MG on top of Ni(111) was made and this value practically independent from the amount of Ag deposited on top of the MG/Ni(111) system before intercalation; after intercalation of 1-2 ML of Ag the formation of the large Ag islands which have a total square less than 50% of the surface can be expected; the agglomeration of the Ag at the surface dislocations and border of the sample can not be excluded.

## V Acknowledgements

This work was performed in framework of INTAS Project No. 2001-2136 and Program of Ministry of Industry and Science of Russian Federation ”Fullerenes and Atomic Clusters”.

Fig.1. PES spectra of the MG/Ni(111), 100 Å of Ag on MG/Ni(111), as well of Ag/MG/Ni(111) system after annealing at 350, 400, 450 and 500 C, respectively.

Fig.2. The changes of relative intensities of the $`\pi _{1v}`$ graphite-derived state and the Ag 4d-derived feature after annealing of the Ag/MG/Ni(111) system at different temperatures in comparison with those for the MG/Ni(111) system and for the ”as-deposited” Ag overlayer on top of MG/Ni(111) system.

Fig.3. a) Intensity of the C(KVV), Ag(M5N45N45), Ni(L3M45M45) and Ni(MVV) AES peaks in dependence from the annealing temperature for 100 Å of pre-deposited Ag on top of MG/Ni(111) system. b) temperature dependence of the intensity ratio (I(Ni848)/I(Ag351)) for different amount of pre-deposited Ag on top of the MG/Ni(111) system.

Fig.4. Series of the angle-resolved PES spectra measured at photon energy of 50 eV for the MG/Ag/Ni(111) system formed after annealing of 100Å Ag+MG/Ni(111) system at 450 C.

Fig.5.Dispersion plot of the main valence band graphite derived electronic states for the Ag/MG/Ni(111) system formed after annealing of 100 Å Ag+MG/Ni(111) system at temperatures of 350 (up triangles), 400 (down triangles) and 450 C (diamonds). The experimental data points for the $`\overline{\mathrm{\Gamma }}\overline{M}`$ direction and photon energy 40.8 eV are shown by open symbols. Here, for comparison the dispersion of the $`\pi `$ and $`\sigma `$ states for the MG/Ni(111) system as well as for pristine graphite are shown by straight and dash-dotted lines, respectively.


text:
# 1 Introduction

## 1 Introduction

Understanding the QCD phase diagram is one of the great challenges in the physics of strong interactions. It is expected that under extreme conditions (high density and or temperature) phase transitions occur leading to a plasma of deconfined quarks and gluons \[QGP\] . While the phase transition at zero chemical potential and finite temperature is accepted to be second order or crossover, there are indications that the phase transition with finite chemical potential and zero temperature is first order. Experimental and theoretical efforts have been done in order to explore the $`\mu T`$ phase boundary. Recent Lattice results indicate a critical ”endpoint”, connecting the first order phase transition with the crossover region at $`T_E=160\pm 35\text{MeV},\mu _E=725\pm 35\text{MeV}`$ . Besides restoration of chiral symmetry and deconfinement, the rich content of the QCD phase diagram has been recently explored in other directions. For instance, in high density matter, for which neutron stars provide an excellent laboratory, a color locked phase with kaon condensates is expected to occur.

Much attention has also been paid to the question of which symmetries are restored. In the limit of vanishing quark masses the QCD Lagrangian has 8 Goldstone bosons, associated with the dynamical breaking of chiral symmetry. In order to give a finite mass to the mesons chiral symmetry is broken ab initio by giving current masses to the quarks, therefore in the high density/temperature regime an indication of the restoration of chiral symmetry would be that the mesons became again almost Goldstone bosons. However, the mass of $`\eta ^{}`$ has a different origin than the masses of the other pseudoscalar mesons and it cannot be regarded as the remanent of a Goldstone boson. The problem of the non-existence of the ninth Goldstone boson, predicted by the quark model, was solved by assuming that the QCD Lagragian has a $`U_A(1)`$ anomaly. The mass of the $`\eta ^{}`$ is obtained by explicitly breaking the $`U_A(1)`$ symmetry, for instance by instantons.

The study of the behavior of mesons in hot and dense matter is an important issue since they might provide a signature of the phase transition and give indications about which symmetries are restored. There is a long standing question  about whether only SU(3) chiral symmetry is restored or both SU(3) and $`U_A(1)`$ symmetries are restored. The behavior of $`\eta ^{}`$ in medium or of related observables like the topological susceptibility might help to decide between these scenarios. A decrease of the $`\eta ^{}`$ mass in medium could manifest in the increase of the $`\eta ^{}`$ production cross section, as compared to that for $`pp`$ collisions .

This paper is devoted to investigate the in medium behavior of the $`\eta \text{ and }\eta ^{}`$ mesons in hot and dense matter in the framework of the SU(3) Nambu-Jona-Lasinio \[NJL\]  model including the ’t Hooft interaction which breaks the $`U_A(1)`$ symmetry. At variance with the other pseudoscalar SU(3) mesons there is not much information about the behavior of these mesons in medium. Concerning the $`\eta `$ meson, the recent discovery of mesic atoms might provide useful information in this concern .

The NJL model is an effective quark model where the gluonic degrees of freedom are supposed to be frozen and, besides its simplicity, has the advantage of incorporating important symmetries of QCD, namely chiral symmetry. Since the model has no confining mechanism, several drawbacks are well known. In what concerns our present problem, it should be noticed that the $`\eta ^{}`$ mass lies above the $`\overline{q}q`$ threshold and the model describes this meson as $`\overline{q}q`$ resonance, which would have the unphysical decay in $`\overline{q}q`$ pairs. For this reason, it has been proposed that in order to investigate the possible restoration of $`U_A(1)`$ symmetry, instead of $`m_\eta ^{}`$, the topological susceptibility $`\chi `$, a more reliable quantity in this model, should be used .

The behavior of SU(3) pseudoscalar mesons, in NJL models, with temperature has been studied in . Different studies have been devoted to the behavior of pions and kaons at finite density in flavor symmetric  or asymmetric matter  . The combined effect of temperature and density on kaons in quark matter simulating symmetric nuclear matter has been investigated in .

In this work we investigate the phase transition and the behavior of $`\eta ,\eta ^{}`$ in strange quark matter in weak equilibrium at zero and finite temperature. We present the model and formalism in the vacuum (Section 2) and at finite density and temperature (Section 3). In Section 4 we discuss present our results for the phase transition in the $`T\rho `$ plane and in Section 5 we present our results and conclusions for the $`\eta ,\eta ^{}`$ behavior.

## 2 Model and Formalism

We will consider in this paper the $`U(1)_A`$ anomaly in the three flavor Nambu - Jona - Lasinio model. The Lagrangian we employ here can be used as an effective theory of QCD and has the following form

$`L`$ $`=`$ $`\overline{q}\left(i\gamma \widehat{m}\right)q+{\displaystyle \frac{g_S}{2}}{\displaystyle \underset{a=0}{\overset{8}{}}}\left[\left(\overline{q}\lambda ^aq\right)^2+\left(\overline{q}(i\gamma _5)\lambda ^aq\right)^2\right]`$ (1)
$``$ $`{\displaystyle \frac{g_V}{2}}{\displaystyle \underset{a=0}{\overset{8}{}}}\left[\left(\overline{q}\gamma _\mu \lambda ^aq\right)^2+\left(\overline{q}(\gamma _\mu \gamma _5)\lambda ^aq\right)^2\right]`$
$`+`$ $`g_D\left[\text{det}\left[\overline{q}(1\gamma _5)q\right]+\text{det}\left[\overline{q}(1\gamma _5)q\right]\right].`$
Here $`q=(u,d,s)`$ is the quark field with three flavors, $`N_f=3`$, and three colors, $`N_c=3`$. $`\lambda ^a`$ are the Gell - Mann matrices, a=$`0,1,\mathrm{},8`$, $`\lambda ^0=\sqrt{\frac{2}{3}}𝐈`$. The explicit symmetry breaking part (1) contains the current quark masses $`\widehat{m}=\text{diag}(m_u,m_d,m_s)`$. Note, that $`m_{u,d}10`$ MeV, $`m_s`$ 100 MeV at the scale of QCD ($``$ 1 GeV). The last term in (1) is the lowest dimensional operator and that has the $`SU_L(3)SU_R(3)`$ invariance but breaks the $`U_A(1)`$ symmetry. This term is a reflection of the axial anomaly in QCD. The model is fixed by the coupling constants $`g_S,g_V,g_D`$, the cutoff parameter $`\mathrm{\Lambda }`$, which regularizes momentum space integrals and current quark masses. In order to fix parameters we will use the values of pseudoscalar meson masses, decay constants and the quark condensates at zero temperature and baryon number density.

Using the definition of the determinant we can rewrite the Lagrangian (1) as

$`L=\overline{q}\left(i\gamma \widehat{m}\right)q+{\displaystyle \frac{g_S}{2}}{\displaystyle \underset{a=0}{\overset{8}{}}}\left[\left(\overline{q}\lambda ^aq\right)^2+\left(\overline{q}(i\gamma _5)\lambda ^aq\right)^2\right]`$ (2)
$``$ $`{\displaystyle \frac{g_V}{2}}{\displaystyle \underset{a=0}{\overset{8}{}}}\left[\left(\overline{q}\gamma _\mu \lambda ^aq\right)^2+\left(\overline{q}(\gamma _\mu \gamma _5)\lambda ^aq\right)^2\right]`$
$`+`$ $`{\displaystyle \frac{g_D}{2}}\left[{\displaystyle \frac{1}{3}}D_{abc}(\overline{q}\lambda ^aq)(\overline{q}\lambda ^bq)(\overline{q}\lambda ^cq)D_{abc}(\overline{q}\lambda ^aq)(\overline{q}(i\gamma _5)\lambda ^bq)(\overline{q}(i\gamma _5)\lambda ^cq)\right]`$
with summation over $`a,b,c=(0,1,2,\mathrm{},8)`$. The structure constants $`D_{abc}`$ are coincident with SU(3) structure constants $`d_{abc}`$ and $`D_{0ab}=\frac{1}{\sqrt{6}}\delta _{ab}`$ and $`D_{000}=\sqrt{\frac{2}{3}}`$. Making the shift

$`(\overline{q}\lambda ^aq)(\overline{q}\lambda ^aq)+<\overline{q}\lambda ^aq>,`$ (3)
where $`<\overline{q}\lambda ^aq>`$ is the vacuum expectation value, and keeping second order terms of $`(\overline{q}\lambda ^aq)`$, we get for pseudoscalar and scalar interactions (for simplicity, we omit vector and axial - vector parts)

$`L=\overline{q}\left(i\gamma \widehat{m}\right)q+{\displaystyle \frac{1}{2}}\left\{(\overline{q}\lambda ^aq)S_{ab}(\overline{q}\lambda ^bq)+(\overline{q}(i\gamma _5)\lambda ^aq)P_{ab}(\overline{q}(i\gamma _5)\lambda ^bq)\right\},`$ (4)
in terms of the projectors

$`S_{ab}`$ $`=`$ $`g_S\delta _{ab}+g_DD_{abc}<\overline{q}\lambda ^cq>,`$ (5)
$`P_{ab}`$ $`=`$ $`g_S\delta _{ab}g_DD_{abc}<\overline{q}\lambda ^cq>.`$ (6)
The hadronization procedure is made via the functional integral

$`Z{\displaystyle 𝑑q𝑑\overline{q}\text{exp}\left\{iW_{eff}[q,\overline{q}]\right\}}`$ (7)
with the quark effective action

$`W_{eff}[q,\overline{q}]={\displaystyle }dxL(x)={\displaystyle }dx[\overline{q}(i\gamma \widehat{m})q`$
$`+{\displaystyle \frac{1}{2}}(\overline{q}\lambda ^aq)S_{ab}(\overline{q}\lambda ^bq)+{\displaystyle \frac{1}{2}}(\overline{q}(i\gamma _5)\lambda ^aq)P_{ab}(\overline{q}(i\gamma _5)\lambda ^bq)].`$ (8)
After integration over quark fields in (7), we obtain the effective meson action

$`W_{eff}[\phi ,\sigma ]`$ $`=`$ $`{\displaystyle \frac{1}{2}}\left(\sigma ^aS_{ab}^1\sigma ^b\right){\displaystyle \frac{1}{2}}\left(\phi ^aP_{ab}^1\phi ^b\right)`$ (9)
$`i\text{Tr}\text{ln}\left[i(\gamma _\mu _\mu )\widehat{m}+\sigma _a\lambda ^a+(i\gamma _5)(\phi _a\lambda ^a)\right].`$
Here the symbol Tr means the summation over discrete indices and integration over continuous variables. The fields $`\sigma ^a`$ and $`\phi ^a`$ are scalar and pseudoscalar meson nonets, respectively.

The first variation of the action (9) leads to the Dyson - Schwinger equation,

$`M_i=m_i2g_S<\overline{q_i}q_i>2g_D<\overline{q_j}q_j><\overline{q_k}q_k>,`$ (10)
with $`i,j,k=u,d,s`$ cyclic. $`M_i`$ are constituent quark masses. The equation (10) is a system of three coupled equations and the flavor mixing occurs through the coupling constant $`g_D`$. It is an effect of anomaly contribution. The quark condensates in (10) are determined by

$`<\overline{q}_iq_i>=i\text{Tr}{\displaystyle \frac{1}{\widehat{p}M_i}}=i\text{Tr}\left[S_i(p)\right].`$ (11)
Here $`S_i(p)`$ is the quark Green function.

To consider the meson mass spectrum, we expand the effective action (9) over meson fields. Keeping the pseudoscalar mesons only, we write the second order effective action as

$`W_{eff}^{(2)}[\phi ]={\displaystyle \frac{1}{2}}\phi ^a\left[P_{ab}^1\mathrm{\Pi }_{ab}(P)\right]\phi ^b`$ (12)
with the polarization operator $`\mathrm{\Pi }_{ab}(P)`$, which in the momentum space has the form

$`\mathrm{\Pi }_{ab}(P)=iN_c{\displaystyle \frac{d^4p}{(2\pi )^4}\text{tr}_D\left[S_i(p+\frac{P}{2})(\lambda ^a)_{ij}(i\gamma _5)S_j(p\frac{P}{2})(\lambda ^b)_{ji}(i\gamma _5)\right]},`$ (13)
where now $`\text{tr}_D`$ is the trace over Dirac matrices. In the result, we have obtained an unnormalized inverse meson propagator $`D_{ab}^1=P_{ab}^1\mathrm{\Pi }_{ab}(P)`$ or

$`D_{ab}={\displaystyle \frac{1}{P_{ab}^1\mathrm{\Pi }_{ab}(P)}}`$ (14)
which is the 3$`\times `$3 matrix in the flavor space. We will neglect $`\pi ^0\eta `$ and $`\pi ^0\eta ^{}`$ mixing terms because they are proportional to $`<\overline{q}_uq_u><\overline{q}_dq_d>`$. We will do the approximation of neglecting also this contribution in the medium. In the basis of $`\eta \eta ^{}`$ mesons we may find $`P_{ab}`$ and $`\mathrm{\Pi }_{ab}(P)`$

$`P_{ab}=\left(\begin{array}{cc}P_{00}& P_{08}\\ P_{08}& P_{88}\end{array}\right)P_{ab}^1={\displaystyle \frac{1}{\mathrm{\Delta }}}\left(\begin{array}{cc}P_{88}& P_{08}\\ P_{08}& P_{00}\end{array}\right)`$ (19)
with the determinant $`\mathrm{\Delta }=P_{00}P_{88}P_{08}^2`$. Then the inverse meson propagator (14) can be presented in the explicit form

$`D_{ab}^1`$ $`=`$ $`{\displaystyle \frac{1}{\mathrm{\Delta }}}\left(\begin{array}{cc}P_{88}\mathrm{\Delta }\mathrm{\Pi }_{00}& P_{08}\mathrm{\Delta }\mathrm{\Pi }_{08}\\ P_{08}\mathrm{\Delta }\mathrm{\Pi }_{08}& P_{00}\mathrm{\Delta }\mathrm{\Pi }_{88}\end{array}\right)`$ (22)
$`=`$ $`{\displaystyle \frac{1}{\mathrm{\Delta }}}\left(\begin{array}{cc}A& B\\ B& C\end{array}\right){\displaystyle \frac{1}{\mathrm{\Delta }}}O^1\left(\begin{array}{cc}\underset{¯}{A}& 0\\ 0& \underset{¯}{C}\end{array}\right)O`$ (27)
with the orthogonal transformation matrix $`O`$. Let us suppose that the matrix $`O`$ has the form

$`O=\left(\begin{array}{cc}\mathrm{cos}\theta & \mathrm{sin}\theta \\ \mathrm{sin}\theta & \mathrm{cos}\theta \end{array}\right).`$ (30)
The value of the angle $`\theta `$ can be fixed from the condition

$`\mathrm{tan}2\theta ={\displaystyle \frac{2B}{CA}}`$ (31)
which guarantees us a diagonal form of $`D_{ab}^1`$. From (30) and (31) we may find $`\underset{¯}{A}`$ and $`\underset{¯}{C}`$ and write $`D_{ab}`$ as

$`D_{ab}^1={\displaystyle \frac{1}{\mathrm{\Delta }}}O^1\left(\begin{array}{cc}\underset{¯}{A}& 0\\ 0& \underset{¯}{C}\end{array}\right)O={\displaystyle \frac{1}{2\mathrm{\Delta }}}O^1\left(\begin{array}{cc}D_\eta ^1& 0\\ 0& D_\eta ^{}^1\end{array}\right)O`$ (36)
where

$`D_\eta ^1=\left(A+C\right)\sqrt{(CA)^2+4B^2}`$ (37)
and

$`D_\eta ^{}^1=\left(A+C\right)+\sqrt{(CA)^2+4B^2}.`$ (38)
The masses of the $`\eta `$ and $`\eta ^{}`$ meson can now be determined by the conditions

$`D_\eta ^1(M_\eta ,\mathrm{𝟎})=0,`$ (39)
$`D_\eta ^{}^1(M_\eta ^{},\mathrm{𝟎})=0.`$ (40)
To calculate the coupling constants, we will express $`D_{ab}`$ directly in the following form

$`D_{ab}=\mathrm{\Delta }\left(\begin{array}{cc}A& B\\ B& C\end{array}\right)^1={\displaystyle \frac{\mathrm{\Delta }}{D}}\left(\begin{array}{cc}C& B\\ B& A\end{array}\right).`$ (45)
Here

$`\mathrm{\Delta }`$ $`=`$ $`P_{00}P_{88}P_{08}^2,`$
$`D`$ $`=`$ $`ACB^2`$
$`=`$ $`\mathrm{\Delta }(1\text{tr}(P\mathrm{\Pi })+\text{det}P\text{det}\mathrm{\Pi })`$
and the effective action (12) now is

$`W_{eff}^{(2)}[\phi ]={\displaystyle \frac{1}{2}}\phi ^aD_{ab}\phi ^b`$ (46)
with

$`D_{ab}={\displaystyle \frac{1}{𝙳}}\left(\begin{array}{cc}C& B\\ B& A\end{array}\right).`$ (49)
It has singularities when $`𝙳`$ equals zero. Making the pole approximation, we expand $`𝙳`$ over $`P^2`$:

$`𝙳(P^2)=𝙳(P^2=M^2)+{\displaystyle \frac{𝙳}{P^2}}_{|_{P^2=M^2}}(P^2M^2).`$ (50)
The first term equals zero when $`P^2=M_\eta ^2`$ (or $`P^2=M_\eta ^{}^2`$). The second term can be rewritten in the rest frame as

$`𝙳(P^2)={\displaystyle \frac{1}{2M}}{\displaystyle \frac{𝙳}{P_0}}_{|_{P_0=M}}(P^2M^2).`$ (51)
In the case $`P^2=M_\eta ^2`$ we have the following expression for the meson propagator

$`D_{ab}={\displaystyle \frac{2M_\eta }{\left(\frac{𝙳}{P_0}\right)_{|_{P_0=M_\eta }}}}{\displaystyle \frac{1}{P^2M_\eta ^2}}\left(\begin{array}{cc}C& B\\ B& A\end{array}\right).`$ (54)
The matrix

$`M_{ab}=g_{a\eta }{\displaystyle \frac{1}{P^2M_\eta ^2}}g_{b\eta }`$ (55)
allows to parameterize the meson propagator in terms of coupling constants $`g_{i\eta }`$ with $`i=0,8`$. Using (55), we obtain

$`g_{0\eta }^2`$ $`=`$ $`{\displaystyle \frac{2M_\eta }{\left(\frac{D}{P_0}\right)_{|_{P_0=M_\eta }}}}C,`$ (56)
$`g_{8\eta }^2`$ $`=`$ $`{\displaystyle \frac{2M_\eta }{\left(\frac{D}{P_0}\right)_{|_{P_0=M_\eta }}}}A,`$ (57)
$`g_{0\eta }g_{8\eta }`$ $`=`$ $`{\displaystyle \frac{2M_\eta }{\left(\frac{D}{P_0}\right)_{|_{P_0=M_\eta }}}}B.`$ (58)
From these coupling constants we may calculate

$`g_{\eta q\overline{q}}`$ $`=`$ $`\sqrt{{\displaystyle \frac{2}{3}}}g_{0\eta }+{\displaystyle \frac{1}{\sqrt{3}}}g_{8\eta },`$ (59)
$`g_{\eta s\overline{s}}`$ $`=`$ $`\sqrt{{\displaystyle \frac{2}{3}}}g_{0\eta }{\displaystyle \frac{2}{\sqrt{3}}}g_{8\eta }.`$ (60)
The coupling constants $`g_{0\eta ^{}},g_{8\eta ^{}},g_{\eta ^{}q\overline{q}},g_{\eta ^{}s\overline{s}}`$ can be evaluated in the same way by the replacement $`M_\eta M_\eta ^{}`$.

Now we consider the properties of $`\eta `$ and $`\eta ^{}`$ mesons.

First we solve the gap equation (10). Then the matrices $`A,B,C,D`$ depend on the solutions of $`M_i`$ and contain the integrals:

$`I_1^i`$ $`=`$ $`iN_c{\displaystyle \frac{d^4p}{(2\pi )^4}\frac{1}{p^2M_i^2}}`$ (61)
and

$`I_2^{ii}(P)`$ $`=`$ $`iN_c{\displaystyle \frac{d^4p}{(2\pi )^4}\frac{1}{(p^2M_i^2)((p+P)^2M_i^2)}},`$ (62)
which are divergent. To calculate the physical observables we introduce the cut - off parameter $`\mathrm{\Lambda }`$. Putting the integrals to (39) we may calculate $`M_\eta `$. But, since NJL does not confine the quarks and the $`\eta ^{}`$ is above the $`\overline{q}_uq_u`$ and $`\overline{q}_dq_d`$ continuum, the meson propagator (40) has complex poles. We assume (see details in  ) that the equation for the poles in the propagator has solutions of the form:

$$P_0=M_\eta ^{}\frac{1}{2}i\mathrm{\Gamma },$$
(63)
where $`M_\eta ^{}`$ is the mass and $`\mathrm{\Gamma }`$ is the width of the $`\eta ^{}`$ \- resonance.

In order to avoid the complexity of the analytical continuation, we calculate the integrals (62) in an approximate way, which means that we neglect $`\mathrm{\Gamma }`$ that occurs in the denominator of $`I_2^{ii}(P_0)`$ and consider the small value of the width. Since this last integral is complex, a straightforward calculation leads to the replacement in $`A,B,C,D`$:

$$P_0^2I_2^{ii}(P_0)\left[P_0^2\text{Re}I_2^{ii}(P_0)+P_0\mathrm{\Gamma }\text{Im}I_2^{ii}(P_0)\right]+i\left[P_0^2\text{Im}I_2^{ii}(P_0)P_0\mathrm{\Gamma }\text{Re}I_2^{ii}(P_0)\right]|_{P_0^2=M_\eta ^{}}.$$
(64)
Therefore from the zeros of the real and imaginary parts of the propagator we get the mass and the width of $`\eta ^{}`$.

For our numerical calculations we use the parameter set:

$`m_u=m_d=5.5`$ MeV, $`m_s=140.7`$ MeV, $`g_S\mathrm{\Lambda }^2=3.67`$, $`g_D\mathrm{\Lambda }^5=12.36`$ and $`\mathrm{\Lambda }=602.3`$ MeV

that has been determined by fixing the conditions:

$`M_\pi =135.0`$ MeV, $`M_K=497.7`$ MeV, $`f_\pi =92.4`$ MeV and $`M_\eta ^{}=960.8`$ MeV.

Here $`f_\pi `$ is the pion decay constant .

Also, we have:

$`M_\eta =514.8`$ MeV, $`\theta (M_\eta ^2)=5.8^{}`$, $`g_{\eta \overline{u}u}=2.29`$, $`g_{\eta \overline{s}s}=3.71`$

and

$`M_\eta ^{}=960.8`$ MeV, $`\theta (M_\eta ^{}^2)=43.6^{}`$, $`g_{\eta ^{}\overline{u}u}=13.4`$, $`g_{\eta ^{}\overline{s}s}=6.72`$.

Note that the $`\eta ^{}`$ \- meson always lies above the quark - antiquark threshold. Since this is an artifact due to the lack of confinement it is a resonant state. Nevertheless, we use $`M_\eta ^{}`$ as an input parameter, because as mentioned in , the chiral susceptibility is related with $`M_\eta ^{}`$ by Witten - Veneziano mass formula

$`{\displaystyle \frac{2N_f}{f_\pi ^2}}\chi =M_\eta ^2+M_\eta ^{}^22M_K^2`$ (65)
and takes the value of $`M_\eta ^{}`$ which is closed to the experimental value. In this formula $`N_f=3`$ and the chiral susceptibility equals $`\chi =(177.2\text{MeV})^4`$. The lattice calculations give the number $`\chi =(175\pm 5\text{MeV})^4`$.

For the quark condensates we have $`<\overline{q}_uq_u>=<\overline{q}_dq_d>=(241.9\text{MeV})^3`$ and $`<\overline{q}_sq_s>=(257.7\text{MeV})^3`$.

## 3 The finite temperature and density case

The generalization of the NJL model to the finite temperature and density case can be done if we introduce the thermal Green function, which for a system of quarks $`q_i`$ at given temperature $`T`$ and chemical potential $`\mu _i`$ is

$`S_i(\stackrel{}{x}\stackrel{}{x}^{},\tau \tau ^{})`$ $`=`$ $`{\displaystyle \frac{i}{\beta }}{\displaystyle \underset{n}{}}e^{i\omega _n(\tau \tau ^{})}{\displaystyle \frac{d^3p}{(2\pi )^3}\frac{e^{i\stackrel{}{p}(\stackrel{}{x}\stackrel{}{x}^{})}}{\gamma _0(i\omega _n+\mu _i)\stackrel{}{\gamma }.\stackrel{}{p}M_i}},`$ (66)
where $`\beta =1/T`$, $`T`$ is the temperature and the sum is made over the Matsubara frequencies $`\omega _n=(2n+1)\pi T`$, $`n=0,\pm 1,\pm 2,\mathrm{}`$, so that $`p_0i\omega _n+\mu _i`$ with a chemical potential $`\mu _i`$. Instead of integration over $`p_0`$ we have now the sum over Matsubara frequencies. $`E_i=\sqrt{𝚙^2+M_i^2}`$ is the quark energy.

Because in the gap equation (10) instead of $`S_i(p)`$ we put the thermal Green functions (66), the current quark masses $`M_i`$ will now depend on the temperature and chemical potential

$$M_i=m_i2g_S<<\overline{q}_iq_i>>\mathrm{\hspace{0.17em}2}g_D<<\overline{q}_jq_j>><<\overline{q}_kq_k>>$$
(67)
where $`<<\overline{q}_iq_i>>`$ are the quark condensates at finite $`T`$ and chemical potential $`\mu _i`$. The condensates are expressed in the terms of the integral $`I_1^i(T,\mu _i)`$ which is calculated by the substitution of (66) in (61)

$`I_1^i(T,\mu _i)={\displaystyle \frac{N_c}{4\pi ^2}}{\displaystyle \frac{𝚙^2d𝚙}{E_i}\left(n_i^+n_i^{}\right)},`$ (68)
with the Fermi distribution functions

$`n_i^{}=\left[1+\text{exp}\left[\beta (E_i\pm \mu _i)\right]\right]^1`$ (69)
The integral $`I_2^{ii}(P_0,T,\mu _i)`$ may be found in the same fashion

$`I_2^{ii}(P_0,T,\mu _i)=`$ $`{\displaystyle \frac{N_c}{2\pi ^2}}𝒫{\displaystyle \frac{𝚙^2d𝚙}{E_i}\frac{1}{P_0^24E_i^2}\left(n_i^+n_i^{}\right)}`$ (70)
$`i{\displaystyle \frac{N_c}{4\pi }}\sqrt{1{\displaystyle \frac{4M_i^2}{P_0^2}}}\left(n_i^+({\displaystyle \frac{P_0}{2}})n_i^{}({\displaystyle \frac{P_0}{2}})\right).`$
Using these integrals we solve equations (39) and (40) at given temperature and chemical potential taking into account also the relations

$`P_{00}(T,\mu _i)`$ $`=`$ $`g_S{\displaystyle \frac{2}{3}}g_D\left(<<\overline{q}_uq_u>>+<<\overline{q}_dq_d>>+<<\overline{q}_sq_s>>\right),`$ (71)
$`P_{88}(T,\mu _i)`$ $`=`$ $`g_S+{\displaystyle \frac{1}{3}}g_D\left(2<<\overline{q}_uq_u>>+2<<\overline{q}_dq_d>><<\overline{q}_sq_s>>\right),`$ (72)
$`P_{08}(T,\mu _i)`$ $`=`$ $`P_{80}={\displaystyle \frac{1}{3\sqrt{2}}}g_D\left(<<\overline{q}_uq_u>>+<<\overline{q}_dq_d>>2<<\overline{q}_sq_s>>\right),`$ (73)
and

$`\mathrm{\Pi }_{00}(P_0,T,\mu _i)`$ $`=`$ $`{\displaystyle \frac{2}{3}}\left[J_{uu}(P_0,T,\mu _i)+J_{dd}(P_0,T,\mu _i)+J_{ss}(P_0,T,\mu _i)\right],`$ (74)
$`\mathrm{\Pi }_{88}(P_0,T,\mu _i)`$ $`=`$ $`{\displaystyle \frac{1}{3}}\left[J_{uu}(P_0,T,\mu _i)+J_{dd}(P_0,T,\mu _i)+4J_{ss}(P_0,T,\mu _i)\right],`$ (75)
$`\mathrm{\Pi }_{08}(P_0,T,\mu _i)`$ $`=`$ $`{\displaystyle \frac{\sqrt{2}}{3}}\left[J_{uu}(P_0,T,\mu _i)+J_{dd}(P_0,T,\mu _i)2J_{ss}(P_0,T,\mu _i)\right],`$ (76)
where

$$J_{ii}(P_0,T,\mu _i)=4(I_1^i+\frac{P_0^2}{2}I_2^{ii}).$$
(77)
## 4 Phase transition

To consider the density effects, in accordance with , we concentrate here on the case of asymmetric quark matter with strange quarks in chemical equilibrium maintained by weak interactions and with charge neutrality, by imposing the following constraints on the chemical potentials of quarks and electrons and on its densities:

$$\mu _d=\mu _s=\mu _u+\mu _e\text{ and }\frac{2}{3}\rho _u\frac{1}{3}(\rho _d+\rho _s)\rho _e=0,$$
(78)
with

$$\rho _i=\frac{1}{\pi ^2}(\mu _i^2M_i^2)^{3/2}\theta (\mu _i^2M_i^2)\text{ and }\rho _e=\frac{\mu _e^3}{3\pi ^2}.$$
(79)
As discussed by several authors, this version of the NJL model exhibits, at $`T=0`$ MeV a first order phase transition .

For the numerical calculations and discussions of the nature of the phase transition we use the expression for the pressure at given temperature which is connected with the thermodynamical potential as

$$P(\rho ,T)=\left[\mathrm{\Omega }(\rho ,T)\mathrm{\Omega }(0,T)\right],$$
(80)
where the thermodynamic potential has the following form

$$\mathrm{\Omega }(\rho ,T)=TS\underset{i=u,d,s}{}\mu _iN_i$$
(81)
and contains the internal energy $``$, the entropy $`S`$ and the number of the $`i`$th quark $`N_i`$.

As a matter of fact, the energy per particle of the quark system has two minimum, corresponding to the zeros of the pressure, the minimum at $`\rho _n=2.25\rho _0`$ being an absolute minimum. This implies that the phase transition in this model is a first order one. The results are presented in Figure 1 (left panel) where we have plotted the pressure in terms of $`\rho _n/\rho _0`$, where $`\rho _n`$ is the neutron matter density and $`\rho _0=0.17`$ fm<sup>-3</sup> is the normal nuclear density.

At finite temperature we conclude that for $`T<56`$ MeV we still have a first order phase transition, but for $`T>T_{cl}=56`$ MeV the phase transition is of second order.

Below this temperature there is a range of densities ($`\rho _n<2.25\rho _0`$) where the pressure and/or the compressibility are negative meaning that the system is in a mixing phase: a low density ($`\rho _n^l`$) phase with massive quarks and a high density ($`\rho _n^{cr}`$) phase with light quarks of (partially) restored chiral symmetry (see also ).

With this parameterization , $`\rho _n^l0`$, and at zero temperature, the model may be interpreted as having a hadronic phase - droplets of light $`u,d`$ quarks with a density $`\rho _n^{cr}=2.25\rho _0`$ surrounded by a non-trivial vacuum - and, above the critical density, a quark phase with partially restored chiral symmetry.

The right panel in Figure 1 shows the combined effect of the temperature and density dependencies of the pressure.

As the temperature increases the pressure becomes positive but the compressibility is still negative. At $`T=56`$ MeV and $`\rho =1.53\rho _0`$, the compressibility has only on zero and we identify this point as the critical endpoint, the connects the first order and second order phase transition regions.

## 5 $`\eta `$$`\eta ^{}`$ behavior in the medium

Figure 2 shows the temperature and density dependencies of constituent quark masses $`M_i`$ (left panel: $`M_u=M_d`$, right panel: $`M_s`$). As we see at low temperature masses are almost constant and then they decrease with increasing temperature. The same situation can be observed in the density direction.

The combined effect of density and temperature shows, as it was expected, that chiral symmetry is partially restored for the light quarks and is badly restored in the strange sector. There is a clear separation between the regions of restored and chiral symmetry in the diagram of the left panel of Figure 2, but the same does not happen in the right panel.

In what concerns the mesonic behavior, before discussing our new findings, we reproduce here the behavior at finite temperature and zero density obtained, for instance in . Figure 3 a) shows the temperature dependence of the $`M_\pi `$, $`M_\eta `$ and $`M_\eta ^{}`$ mesons with vanishing chemical potential. For comparison, the curve of $`2M_u`$ is also indicated. One see that at low temperature the $`M_\pi `$, $`M_\eta `$ masses are lower than masses of their constituents. In this case the integrals $`I_2^{ii}(P_0,T)`$ are real. The crossing of the $`\pi `$ and $`\eta `$ lines with $`2M_u`$ line indicates the respective Mott transition temperature $`T_M`$ for these mesons. For our set of parameters the mesons become unbound at $`T_M200`$ MeV. One can also see that $`T_{M\eta }<T_{M\pi }`$. Above the Mott temperature we have taken into account the imaginary parts of the integrals $`I_2^{ii}(P_0,T)`$ and used a finite width approximation . As we mentioned before the $`\eta ^{}`$ \- meson is unbound.

We start the discussions of the $`\eta `$ and $`\eta ^{}`$ in matter from the properties of dynamical quark masses and chemical potentials. They are plotted in Figure 4 as functions of $`\rho _n`$.

An important point to be noticed is that, due to the ’t Hooft contribution in the gap equations, the mass of the strange quark decreases smoothly and becomes lower than the chemical potential at densities above 3.9$`\rho _0`$, which we will denote from now on as $`\rho _s^{}`$. A more pronounced decrease is then observed, which is due to the presence of $`s`$ quarks in this regime. As it will be discussed below, this fact is related to a change in the behavior of different observables, as compared to the region of lower densities. At $`\rho =\rho _s^{}`$ (Figure 4) the difference between the chemical potentials $`\mu _d=\mu _s`$ has a maximum and, as the density increase there is a tendency to the restoration of flavor symmetry .

Now, we analyze the results for the masses of $`\eta `$ and $`\eta ^{}`$.

Having in mind the constraints (78) and (79) we have calculated the density dependence of $`M_\eta `$ and $`M_\eta ^{}`$ masses. The results are shown on Figure 3-b.

In order to understand these results, it is useful to study the limits of the Dirac sea of this mesons. They can be obtained by looking the limits of the regions of poles in the integrals $`I_2^{ii}(P_0)`$ (70) and are plotted in Figure 3 (dashed point lines): $`\omega _u=2\mu _u`$, $`\omega _d=2\mu _d`$ and $`\omega _s=2\mu _s`$. (At finite temperature, we will have $`\omega _u=2M_u`$, $`\omega _d=2M_d`$ and $`\omega _s=2M_s`$).

As we can see, the $`\eta ^{}`$ \- meson lies above the quark - antiquark threshold for $`\rho _n<2.5\rho _0`$ and it is a resonant state. After that density, the $`\eta ^{}`$ becomes a bound state.

Concerning the masses of $`\eta `$ and $`\eta ^{}`$ they exhibit a tendency to became degenerate but there are no clear indications of restoration of $`U_1(A)`$ symmetry. In neutron matter with beta equilibrium the systems shows a tendency to the restoration of flavor symmetry, which is related with the presence of strange quarks in the medium that occurs at about $`\rho 3.8\rho _0`$.

Concerning the behavior in a hot and dense medium, a feature to be noticed is that the $`\eta `$ meson, that has a Goldstone boson like nature, shows more clearly the difference between the chiral symmetric and asymmetric phase, as shown in Figure 5. In conclusion, in the framework of our model, if the behavior of $`\eta ^{}`$ at high temperatures and zero density suggests a possible restoration of the $`U_A(1)`$ symmetry, the same does not happen when we explore the high density region of a dense or hot and dense medium.

Acknowledgement:

Work suported by grant SFRH/BD/3296/2000 (P. Costa), Centro de Física Teórica, FCT and GTAE (Yu. L. Kalinovsky).