text:
# Cosmic shear statistics in the Suprime-Cam 2.1 sq deg field: Constraints on Ωₘ and 𝜎₈Based on data collected at Subaru Telescope, which is operated by the National Astronomical Observatory of Japan.

## 1 Introduction

Cosmic shear, that is coherent distortions in distant galaxy images resulting from weak gravitational lensing by large-scale structures, has been recognized as a powerful tool for cosmology because it directly probes matter distribution regardless of any relation between mass and light (for reviews see, Mellier 1999, Bartelmann & Schneider 2001). Since the first reports of the detection of cosmic shear correlations (Van Waerbeke et al., 2000; Witteman et al., 2000; Bacon, Refregier & Ellis 2000; Kaiser, Wilson & Luppino 2000; Maoli et al. 2001; ), cosmic shear statistics have become a promising probe of cosmological parameters. Indeed, recent measurements of cosmic shear correlation have put useful constraints on the matter density parameter $`\mathrm{\Omega }_\mathrm{m}`$ and the matter power spectrum normalization $`\sigma _8`$ (Maoli et al. 2001; Bacon et al. 2002; Van Waerbeke et al. 2001; 2002; Hoekstra et al. 2002a; Hoekstra, Yee & Gladders 2002b; Brown et al. 2003; Jarvis et al. 2003). As the cosmic shear correlation is primarily sensitive to density fluctuation at intermediate redshifts ($`0.2<z<0.7`$) and on scales from quasi-linear to nonlinear ($`1<\theta <50`$ arcmin corresponding to comoving scales of $`0.38<r<19.2h^1`$Mpc at $`z=0.5`$ for a cosmological model with $`\mathrm{\Omega }_\mathrm{m}=0.3`$ and $`\mathrm{\Omega }_\mathrm{\Lambda }=0.7`$), it provides cosmological information that is independent of other observations, such as galaxy clustering, cluster number counts, and the cosmic microwave background anisotropies, and thus is complementary to these techniques.

Cosmic shear measurement is not an easy task; it requires a rigorous observation strategy, specifically, a deep and wide-field survey with very high image quality. A large number density of distant galaxies, ideally $`n_g>30`$arcmin-2, is needed to suppress random noise due to the intrinsic galaxy ellipticity. A wide survey area is necessary for suppression of the cosmic variance. In addition, good seeing conditions are essential for precise measurements of a galaxy’s shape. Suprime-Cam, a wide-field camera mounted on the prime focus of the 8.2-m Subaru telescope, is an almost ideal camera for a weak lensing survey. It has a field of view of $`34\mathrm{}\times 27\mathrm{}`$ with $`0\mathrm{}.202`$ pixel-1. The median seeing in the $`I_c`$ band, monitored over a period of one-and-a-half years, is reported to be $``$ 0.6 arcsec (Miyazaki et al. 2002b). Subaru’s light-gathering power enables a complete magnitude of $`R_C=25.2`$ (the turn-around of galaxy counts) to be obtained by a 30-min exposure, which provides a galaxy number density of $`n_g33`$arcmin-2, after object selection (see §3). These advantages allow a weak lensing survey to be carried out efficiently.

In this paper we present the results of our analysis of $`R_c`$-band imaging data from a Suprime-Cam 2.1 deg2 field. This field is composed of nine pointings in a $`3\times 3`$ mosaic configuration which covers a contiguous $`1.64\mathrm{°}\times 1.28\mathrm{°}`$ area. A great advantage of these data is their very good and homogeneous image quality over the whole field, which allows us to obtain secure weak lensing measurements. These data were also used for the first halo number counts using the weak lensing technique (Miyazaki et al., 2002a), which demonstrated that a weak lensing halo survey is indeed a promising way to study the distribution and evolution of large-scale structures. In this paper, we concentrate on the measurement of cosmic shear correlations caused by large-scale structures. We carry out a full maximum likelihood analysis of the cosmic shear correlation over four parameters, $`\mathrm{\Omega }_\mathrm{m}`$, $`\sigma _8`$, $`\mathrm{\Gamma }`$ (a shape parameter of the Cold Dark Matter power spectrum) and $`\overline{z}_s`$ (the mean redshift of the source galaxy distribution). We derive joint constraints on two parameters by marginalizing over the two remaining parameters, and obtain a constraint on $`\mathrm{\Omega }_\mathrm{m}`$ and $`\sigma _8`$. We also obtain an upper limit on $`\mathrm{\Gamma }`$. Confidence intervals on $`\sigma _8`$ for the currently popular $`\mathrm{\Lambda }`$CDM model ($`\mathrm{\Omega }_\mathrm{m}=0.3`$, $`\mathrm{\Omega }_\mathrm{\Lambda }=0.7`$ and $`\mathrm{\Gamma }=0.21`$) are also derived.

The outline of this paper is as follows. In §2 we briefly discuss the theory of cosmic shear statistics and summarize the analytical formulas that are used to compute the theoretical predictions. Details of the observations and data are described in §3. A galaxy shape analysis is presented in §4. Measurement of the cosmic shear correlation is presented in §5. The measured cosmic shear correlation signal is compared with the theoretical prediction using maximum likelihood analysis in §6. Finally, §7 presents a summary and discussion. In the Appendix, we discuss tests of the anisotropic point spread function correction procedure in some detail.

## 2 Basics of cosmic shear correlation

In this section, we provide a basic description of the theory of the cosmic shear correlation (see the reviews by Mellier 1999; Bartelmann & Schneider 2001 for details).

The observable shear two-point statistics can be related to the convergence power spectrum defined by

$$P_\kappa (l)=\frac{9\mathrm{\Omega }_\mathrm{m}^2}{4}\left(\frac{H_0}{c}\right)^4_0^{\chi _H}𝑑\chi \left[\frac{W(\chi )}{a(\chi )}\right]^2P_\delta [\frac{l}{f_K(\chi )};\chi ],$$
(1)
where $`H_0`$ is the Hubble parameter, $`\chi `$ is the radial comoving distance, $`\chi _H`$ corresponds to the horizon, $`a(\chi )`$ is the scale factor and $`f_K(\chi )`$ is the comoving angular diameter distance. $`P_\delta (k)`$ is the matter power spectrum, for which we adopt the fitting function of the CDM power spectrum given by Bardeen et al. (1986), but we treat the shape parameter, $`\mathrm{\Gamma }`$, as a free parameter. To take into account the effect of nonlinear growth of the density field, which has a significant impact on the shear correlation function on scales below one degree (Jain & Seljak 1997), we use the fitting function of Peacock & Dodds (1996). $`W(\chi )`$ is the source weighted distance ratio given by,

$$W(\chi )=_\chi ^{\chi _H}𝑑\chi ^{}n_s(\chi ^{})\frac{f_K(\chi ^{}\chi )}{f_K(\chi )},$$
(2)
here $`n_s(\chi )`$ is the normalized redshift distribution of source galaxies, which we discuss later (§6.1).

Several real space estimators of the shear correlation have been proposed, including: the shear two-point correlation function (Blandford et al. 1991; Miralda-Escude 1991; Kaiser 1992), the top-hat shear variance (Bernardeau, Van Waerbeke & Mellier 1997) and the aperture mass variance (Schneider et al. 1998). For our maximum likelihood analysis, we adopt the aperture mass variance, which has the very useful property that it naturally carries out E/B mode decomposition (Schneider et al. 1998; Crittenden et al. 2002; Pen, Van Waerbeke & Mellier 2002). As gravitational lensing produces only E mode shear, E/B mode decomposition allows contamination from B mode shear (which is not caused by gravitational lensing) to be suppressed, and the amplitude of the B mode variance can be used to estimate the amplitude of the systematic error. The aperture mass is defined by

$$M_{ap}=d^2\theta U(\theta )\kappa (𝜽),$$
(3)
where $`\kappa (\theta )`$ is the lensing convergence field, and $`U(\theta )`$ is the compensated filter, for which we adopt the following function proposed by Schneider et al. (1998)

$$U(\theta )=\frac{9}{\pi \theta _{ap}^2}\left(1\frac{\theta ^2}{\theta _{ap}^2}\right)\left(\frac{1}{3}\frac{\theta ^2}{\theta _{ap}^2}\right),$$
(4)
for $`\theta <\theta _{ap}`$, and 0 otherwise. It should be emphasized that this filter probes an effective scale of $`\theta _{ap}/5`$ not $`\theta _{ap}`$. The aperture mass can be calculated directly from the tangential shear $`\gamma _t`$ (the tangential component of shear defined in the local frame connecting the aperture center to a galaxy), without the need for a mass reconstruction, by

$$M_{ap}=d^2\theta Q(\theta )\gamma _t(\theta ),$$
(5)
where $`Q(\theta )`$ is given from $`U(\theta )`$:

$$Q(\theta )=\frac{2}{\theta ^2}𝑑\theta ^{}U(\theta ^{})U(\theta ).$$
(6)
The aperture mass variance is related to the convergence power spectrum eq. (1) by

$$M_{ap}^2(\theta _{ap})=2\pi 𝑑llP_\kappa (l)\left[\frac{12}{\pi (l\theta _{ap})^2}J_4(l\theta _{ap})\right]^2,$$
(7)
where $`J_4`$ is a fourth-order Bessel function of the first kind.

We compute the aperture mass variances from the shear correlation functions using relations eqs. (11) and (12). This approach has some advantages over direct measurement in that (i) it is the least affected by defects in the data, such as masking by bright stars, (ii) and it does not depend on the geometry of the data; (iii) thus it uses all information in the data (Hoekstra et al. 2002b). The two shear two-point correlation functions that are measured are:

$$\xi _{tt}(\theta )=\frac{\underset{i,j}{\overset{N_s}{}}w_iw_j\gamma _{t,i}\gamma _{t,j}}{_{i,j}^{N_s}w_iw_j},$$
(8)
and

$$\xi _{rr}(\theta )=\frac{\underset{i,j}{\overset{N_s}{}}w_iw_j\gamma _{r,i}\gamma _{r,j}}{_{i,j}^{N_s}w_iw_j},$$
(9)
where $`\theta =|𝒙_𝒊𝒙_𝒋|`$, $`N_s`$ is the number of source galaxies, $`\gamma _t`$ and $`\gamma _r`$ are the tangential and 45$`\mathrm{°}`$ rotated shear in the frame connecting the pair of galaxies, and $`w`$ is a weight that expresses the reliability of the shape measurement for each galaxy (discussed in §4). For the following discussion, it is useful to define, $`\xi _+(\theta )`$ and $`\xi _{}(\theta )`$, which are the sum and difference of the shear two-point correlation functions defined by eqs. (8) and (9), respectively

$$\xi _+(\theta )=\xi _{tt}(\theta )+\xi _{rr}(\theta ),\text{and}\xi _{}(\theta )=\xi _{tt}(\theta )\xi _{rr}(\theta ).$$
(10)
The E and B modes’ (which we denote by $`M_{}`$) aperture mass variances are derived by integration of these correlation functions with an appropriate window

$$M_{ap}^2(\theta _{ap})=\pi _0^{2\theta _{ap}}𝑑\theta \theta \left[𝒲(\theta )\xi _+(\theta )+\stackrel{~}{𝒲}(\theta )\xi _{}(\theta )\right],$$
(11)
and

$$M_{}^2(\theta _{ap})=\pi _0^{2\theta _{ap}}𝑑\theta \theta \left[𝒲(\theta )\xi _+(\theta )\stackrel{~}{𝒲}(\theta )\xi _{}(\theta )\right],$$
(12)
where $`𝒲`$ and $`\stackrel{~}{𝒲}`$ are given in Crittenden et al. (2002); useful analytical expressions were derived by Schneider et al. (2002).

## 3 Data

Observations were made with the Suprime-Cam on the Subaru 8.2-m telescope during its commissioning phase. We used a field size of 2.1 deg2, which was the largest size possible during that period.

The field that we chose was centered at R.A. = 16h04m43s, decl. = +43°12′19″(J2000.0). We obtained $`R_c`$-band images on the nights of 2001 April 23-25. Suprime-Cam has a field of view of 34′$`\times `$ 27′with a scale 0″.202 pixel-1 (see Miyazaki et al. 2002 for instrumental details of Suprime-Cam). Nine contiguous fields were observed in a 3$`\times `$3 mosaic configuration. Each exposure on a given field was offset by $`12`$′from the other exposures to allow the removal of cosmic rays and defects on the CCDs. The total exposure time of each field was 1800 sec (360 sec $`\times `$ 5).

We apply the weak lensing mass reconstruction technique to these data (Miyazaki et al. 2002a). The number counts of high peaks (above 5-$`\sigma `$), which represent massive dark halos, in the reconstructed convergence field is $`4.9\pm 2.3`$, where the Gaussian smoothing radius of the convergence map is $`1\mathrm{}`$. This result is consistent with predictions thatassume the Press-Schechter mass function (Press & Schechter 1974; we used the version modified by Sheth & Tormen 1999) and the universal NFW halo profile (Navarro, Frenk & White 1996) under the cluster normalized CDM cosmology. Thus, it is unlikely that this field is significantly far from the cosmic mean.

The individual images were de-biased and then flattened using a median of all the object frames taken during the observing run. Stacking the dithered images is not a trivial procedure because of the large distortion in the optics, combined with the alignment error of each CCD with displacement and rotation from its nominal position. We present here an outline of how to obtain parameters that transform a CCD coordinate to a standard celestial coordinate. First, we employ a geometrical model of the field distortion using a fourth order polynomial function

$$\frac{Rr}{r}=ar+br^2+cr^3+dr^4,$$
(13)
where $`R`$ and $`r`$ are the distance from the optical axis in units of pixels on the face of the CCD and in celestial coordinates, respectively. We typically changed the telescope pointing by 1$``$2 arcmin between successive exposures to fill the gaps between the CCDs. The offset and rotation of the telescope pointing between the exposures are also set as free parameters. All of these parameters can be determined by minimizing the distance of the same stars identified on different exposures. To do this, we adopt a modified version of $`mosaicfit`$, which is one of the functions of the $`imcat`$ suite.

Once we have obtained these parameters, we use them to warp each image before stacking. The residual of the distances between corresponding star images is a measure of the error of this mosaic-stacking procedure. The RMS value of the residuals is typically about 0.5 pixels. As shown in Miyazaki et al. (2002b), distortion parameters obtained in this way match quite well with the residuals predicted by optical ray-tracing programs, which implies that our solution is satisfactory.

The RMS residual of 0.5 pixels is due to several effects that are not considered in the simple model, including atmospheric dispersion and asymmetric aberration of the optics. We note, however, that the residual vector changes smoothly with position and can be well modeled as a third order bi-linear polynomial function of position. This model then gives a fine correction to our geometrical solution described above. The measurements of the displacement and the warping of the images are carried out using fitgeometry2 and $`mosaicmap`$ of $`imcat`$, respectively, as described by Kaiser et al. (1999). As a result of these procedures, the final residual typically decreases down to 0.07 pixel RMS (14 milliarcsec). To derive a better astrometric solution, an external reference star catalog would have to be used. However, we simply employ each first exposure as a reference and accept the resulting moderate astrometric accuracy, as it does not significantly affect the weak lensing analysis. The individual images are then warped using the solution, and stacked. The seeing in the resulting image is 0″.68 FWHM and the scatter among the fields is quite small at 0″.04 rms.

To carry out object detection, photometry and shape measurements of objects, we use hfindpeaks, apphot and getshapes of the $`imcat`$ suite, which are an implementation of Kaiser et al. (1995). Catalogs created for the nine fields are registered using stars in the overlapping regions to generate a final catalog whose total field of view is 1.64°$`\times `$ 1.28°. Differences in the photometric zero point among the fields due to variation in the sky conditions (in turn, due to thin cirrus and differing air mass) are compensated for at this stage, but the adjustment is not significant ($``$ 0.05 mag).

We adopt slightly different object selection criteria to those used by Miyazaki et al. (2002a) to optimize our cosmic shear correlation measurement. Our criteria are (i) $`22.5<R_c<26`$. (ii) The signal-to-noise (S/N) ratio, $`nu`$, calculated in imcat, exceeds 7 (Erben et al. 2001). (iii) The image size is larger than the PSF size, $`rg>1.451.65`$, where $`rg`$ is a measure of the size of objects (in pixel units) yielded by imcat. The PSF size is identified from the stellar branch in the size-magnitude ($`rg`$-$`R_c`$) plane. The PSF size varies slightly from pointing to pointing because of changes in the seeing conditions. (iv) Objects with $`rh>10`$ pixels (where $`rh`$ is the half light radius) are considered too large and removed. (v) Highly elliptical objects, where the observed ellipticity, $`|e^{obs}|>0.5`$, are removed. (vi) Objects that have a close companion, with a separation of less than 10 pixels ($`2`$ arcsec), are removed to avoid the problem of overlapping isophotes reported by Van Waerbeke et al. (2000). The number of objects that pass these various selection criteria (i)-(vi) is 249,071 (32.9 arcmin-2).

Van Waerbeke et al. (2000) reported that regions where data from different CCDs are stacked together as a result of offsets between exposures (specifically, the edges of CCDs) can potentially produce discontinuities in the properties of the field and thus make the PSF correction difficult. This effect could cause a systematic error in the cosmic shear correlation measurement. Therefore, we decided to mask such regions. That is, we use only objects that were observed by the same CCD. About 35% of the objects are removed by this masking, and the number of objects in the final catalog is 161,740. The image size distribution and magnitude distribution of the catalog are shown in the upper panel of Figure 2 and Figure 2, respectively.

## 4 Galaxy shape analysis

The observed ellipticity of galaxies is measured from the weighted quadrupole moments $`I_{ij}`$ of the surface brightness $`f(𝜽)`$:

$$𝒆_{𝒐𝒃𝒔}=(\frac{I_{11}I_{22}}{I_{11}+I_{22}},\frac{I_{12}}{I_{11}+I_{22}}),I_{ij}=d^2\theta W_G(\theta )\theta _i\theta _jf(𝜽),$$
(14)
where $`W_G(\theta )`$ is the Gaussian window function. Estimating the shear, $`𝜸`$, from the observed ellipticities, $`𝒆_{𝒐𝒃𝒔}`$, involves two steps: First, the point spread function (PSF) anisotropy is corrected using the star images as references,

$$𝒆=𝒆_{𝒐𝒃𝒔}\frac{P_{sm}}{P_{sm}^{}}𝒆_{𝒐𝒃𝒔}^{\mathbf{}},$$
(15)
where $`P_{sm}`$ is the smear polarisability tensor, which is mostly diagonal (Kaiser et al. 1995). $`(P_{sm}^{})^1𝒆_{𝒐𝒃𝒔}^{\mathbf{}}`$ was calculated for stars scattered over the field of view. We use unsaturated stars selected by the following criteria: (i) $`20.6<R_c<23.0`$ (using fainter stars than this does not change the results, see the Appendix). Note that the saturation level identified from the size-magnitude ($`rg`$-$`R_c`$) plane is $`R_c=19.520.5`$ which correlates with the seeing (with a fainter saturation level for a better seeing). (ii) $`nu>15`$. (iii) The image size is within a narrow range of the seeing size, $`rg_{}0.05<rg<rg_{}+0.05`$, where $`rg_{}`$ denotes the central $`rg`$ value (in pixel units) of the stellar branch in the $`rg`$-$`R_c`$ plane. $`rg_{}`$ varies from pointing to pointing and is $`rg_{}=1.271.52`$. (iv) Highly elliptical objects, with an observed ellipticity, $`|e|>0.3`$, are removed. As a result, the average number density of the selected stars is about 1/arcmin2, and there are on average about 60 stars in each chip. However, the chip-by-chip variation in the number of stars is quite large; some chips have only $``$20 stars because of the presence of a large saturated star in the field. We make the first order bi-polynomial fit to values of $`(P_{sm}^{})^1𝒆_{𝒐𝒃𝒔}^{\mathbf{}}`$ as a function of position (a second order fit does not change the results, see the Appendix). To make this fit, we use the efit command in imcat, and flux weighting is not applied. This function is used in eq. (15) to correct the ellipticities of faint galaxies. This correction is made with the ecorrect command in imcat. Note that each CCD chip is treated independently in this procedure. We found that a first order fit corrects the PSF anisotropy well, and furthermore does not introduce a systematic artificial residual due to the wings of a higher order fit (Van Waerbeke et al. 2002), provided that overlapped CCD regions are masked. The RMS value of the ellipticities of the reference stars, $`|𝒆^{\mathbf{}}|^2^{1/2}`$, is reduced from 2.8% to 1.0% as a result of the correction. Note that the RMS before the correction is already small, because of the superb image quality of the Subaru telescope. Figure 4 shows the star ellipticities before (left panel) and after (right panel) the anisotropic PSF correction from one pointing. The observed ellipticities not only have a large scatter but also show a systematic effect. After the PSF correction this tendency is removed and the corrected star ellipticities are distributed symmetrically around zero with a small scatter.

Figure 4 shows the average ellipticity of galaxies as a function of the value of the star ellipticity used for the anisotropic PSF correction. The top panels show the observed ellipticities, and the expected strong correlation is present. Note that for the majority of galaxies, the PSF anisotropy is very small, as shown in the bottom panels. The corrected ellipticities plotted in the middle panels comprise only small values. The averaged values of the corrected ellipticities are $`e_1=5.0\times 10^4`$ and $`e_2=1.8\times 10^3`$. Thus, no significant offset is found.

The second step is the isotropic correction, caused by the window, $`W_G`$, and the seeing. Luppino & Kaiser (1997) reported a method to correct the ellipticities for these effects. The pre-seeing shear $`𝜸`$ is described as

$$𝜸=P_\gamma ^1𝒆,P_\gamma =P_{sh}\frac{P_{sh}^{}}{P_{sm}^{}}P_{sm},$$
(16)
where $`P_{sh}`$ is the shear polarisability tensor. The $`P_\gamma `$ of individual galaxies is, however, known to be a noisy estimate, and thus we adopt the smoothing and weighting method developed by Van Waerbeke et al.(2000; see also Erben et al. 2001 for a detailed study of the smoothing scheme). For each object, 20 neighbors are first identified in the $`r_g`$-$`R_c`$ plane. A median value of $`P_\gamma `$ among these neighbors is adopted as the smoothed $`P_\gamma `$ of the object. The averaged $`\mathrm{tr}(P_\gamma )`$ for all objects is calculated as $`0.40`$ but $`P_\gamma `$ depends on the object size. Figure 2 plots the averaged tr$`(P_\gamma )`$ as a function of $`rg`$. This graph shows that the average $`\mathrm{tr}(P_\gamma )`$ is almost constant, $`0.65`$ for $`r_g>3.5`$, but becomes smaller for smaller $`r_g`$.

As the estimated $`𝜸`$ is still noisy, especially for small and faint objects, it is important to weight the galaxies according to the uncertainty in the shape measurements. We weight the objects using the procedure developed by Van Waerbeke et al. (2000; 2002; see also Erben et al. 2001). The variance of raw $`𝜸`$ before the smoothing among the neighbors, $`\sigma _\gamma ^2`$, is used to estimate the weight of each object, $`w`$, as

$$w=\frac{1}{\sigma _\gamma ^2+\alpha ^2}$$
(17)
where $`\alpha ^2`$ is the variance of all the objects in the catalog and $`\alpha 0.4`$ here. Under the weighting scheme, an averaged value of a certain observable, $`A`$, is calculated as $`_{i=1}^Nw_iA_i/_{i=1}^Nw_i`$ instead of $`_{i=1}^NA_i/N`$. The lower panel of Figure 2 shows the averaged weight as a function of $`R_c`$ magnitude. As expected, less weight is given to fainter objects because the shape measurements of these objects are noisier. The dashed histogram in the upper panel of Figure 2 plots the product of the number counts and the average weight and shows that the effective counts peak at $`R_c24.5`$.

## 5 Cosmic shear correlations

In this section, we present the cosmic shear correlations measured from the 2.1 deg2 Suprime-Cam data, and discuss their statistical and possible systematic errors.

The top and middle panels of Figure 4 show the shear correlation functions, $`\xi _{tt}`$ and $`\xi _{rr}`$, respectively, computed using the estimator eqs. (8) and (9). The bottom panel presents the cross-correlation $`\xi _{tr}`$. The error bars indicate the RMS among 100 randomized realizations, in which the orientations of galaxies are randomized, and presumably represent the statistical error. In the following, statistical errors are computed in this manner. As the two top panels clearly show, we detect non-zero shear correlation signals on scales below 30 arcmin, except for the smallest two bins. On small scales ($`\theta <1`$ arcmin) the number of pairs corresponding to the separations decreases, and consequently the signals become noisy and the statistical errors become large. As the cross-correlation should be zero for a signal due to gravitational lensing, it provides a check on systematic effects in the data. The bottom panel shows that the cross-correlation is indeed consistent with zero at all scales. This result indicates that our PSF corrections perform well and do not introduce a systematic effect into the data.

Let us now turn to the aperture mass variance. We compute the E and B mode aperture mass variances from the two-point shear correlation functions via eqs. (11) and (12). We use the analytic expressions for the window function $`𝒲`$ and $`\stackrel{~}{𝒲}`$ given in Schneider et al. (2002). The shear correlation functions defined by eq. (10) are computed over the range $`0.04\mathrm{}<\theta <90\mathrm{}`$ on 168 bins equally spaced with a log-interval of $`\mathrm{\Delta }\mathrm{log}\theta =0.02`$. The E and B mode aperture mass variances are plotted in Figure 5. For the E mode, we detect positive, non-zero signals on scales larger than $`\theta _{ap}>2\mathrm{}`$. Since, as shown in Figure 4, the two-point correlation function becomes very noisy on scales smaller than 1 arcmin, and also considering that the aperture mass effectively probes a real scale of $`\theta _{ap}/5`$, we use only the signals on scales larger than $`\theta _{ap}=2`$ arcmin for our maximum likelihood analysis in the next section. The amplitude and main features of the E mode variance are broadly consistent with theoretical predictions under the cluster normalized CDM cosmology (see Figure 6.2).

The B mode aperture mass variance is shown in the lower panel of Figure 5. Small but non-zero signals are found on scales larger than 5 arcmin. Currently, the origin of this B mode variance is not clear. One possibility is incorrect anisotropic PSF correction. We tested this possibility by repeating the PSF correction using different procedures, and found no significant problems (see the Appendix). It is interesting to note that Van Waerbeke et al. (2002) reported the detection in their data of a non-zero B mode variance ($`M_{}^23\times 10^6`$) on scales $`10\mathrm{}<\theta _{ap}<40\mathrm{}`$, the amplitude of which is very similar to ours. Note that their survey depth (a limiting magnitude of $`I_{AB}=24.5`$) was slightly shallower than ours. On the other hand, Hoekstra et al. (2002b) reported a vanishing B mode variance on scales larger than 10 arcmin in their shallow data ($`R_c<24`$). These results suggest that the current procedures for galaxy shape corrections become problematic for fainter objects. Unfortunately, we cannot test this possibility because the number of brighter galaxies is not sufficient to obtain meaningful statistics. This possibility should be tested in future studies.

Currently, it is not clear how to correct the E mode variance, given the observed B mode. We follow Van Waerbeke et al. (2002b) and add the B mode in quadrature to the uncertainty in the E mode for the maximum likelihood analysis (see §6).

## 6 Likelihood analysis

In this section, we compare the measured aperture mass variance to the model predictions in CDM cosmologies using maximum likelihood analysis. We present constraints on cosmological parameters obtained from the cosmic shear variance observed in the Suprime-Cam 2.1 degree2 field data.

### 6.1 Source redshift distribution

To compute the theoretical prediction of the aperture mass variance using eq. (7), we need to fix the redshift distribution of the source galaxies. However, no redshift information about the galaxies in our catalog is available. Therefore, we decided to adopt a parameterized model that provides a good fit to the redshift distribution of deep surveys (e.g., Hoekstra et al. 2002b; Van Waerbeke et al. 2002),

$$n_s(z)=\frac{\beta }{z_{}\mathrm{\Gamma }\left[(1+\alpha )/\beta \right]}\left(\frac{z}{z_{}}\right)^\alpha \mathrm{exp}\left[\left(\frac{z}{z_{}}\right)^\beta \right],$$
(18)
with $`\alpha =2`$ and $`\beta =1.5`$. The mean redshift relates to $`z_{}`$ as $`\overline{z}_s=z_{}\mathrm{\Gamma }\left[(2+\alpha )/\beta \right]/\mathrm{\Gamma }\left[(1+\alpha )/\beta \right]`$ and for these values of $`\alpha `$ and $`\beta `$, it gives $`\overline{z}_s1.5z_{}`$. The median redshift is approximately given by $`z_{med}1.4z_{}`$. We treat the mean redshift of the distribution as a model parameter in the maximum likelihood analysis.

### 6.2 Maximum likelihood analysis

In performing the maximum likelihood analysis, we basically follow the procedure described in Van Waerbeke et al. (2002; see also Hoekstra et al. 2002b). The theoretical predictions are computed in a four-dimensional space, but we restrict the parameter space to realistic but conservative ranges: $`\mathrm{\Omega }_\mathrm{m}[0.1,1]`$ (either $`\mathrm{\Omega }_\mathrm{\Lambda }=0`$ or $`\mathrm{\Omega }_\mathrm{m}+\mathrm{\Omega }_\mathrm{\Lambda }=1`$), $`\sigma _8[0.2,2]`$, $`\mathrm{\Gamma }[0.05,0.75]`$ and $`\overline{z}_s[0.3,2.5]`$ with a sampling of $`19\times 19\times 11\times 23`$. In what follows, we refer to this parameter range ($`\mathrm{\Omega }_\mathrm{m}`$, $`\sigma _8`$, $`\mathrm{\Gamma }`$, $`\overline{z}_s`$) as the default prior space. The model predictions are then interpolated with an oversampling fivefold higher in each dimension.

For a given theoretical model, we compute the $`\chi ^2`$ (log-likelihood)

$$\chi ^2=(d_im_i)\text{C}^1(d_im_i)^T,$$
(19)
where $`d_i`$ is the measurement at scale $`\theta _i`$, and $`m_i`$ is the corresponding theoretical prediction. Confidence values are computed from this $`\chi ^2`$ in the standard manner. The covariance matrix consists of three contributions

$$C(\theta _i,\theta _j)=C_s(\theta _i,\theta _j)+C_b(\theta _i,\theta _j)+C_{cv}(\theta _i,\theta _j),$$
(20)
where $`C_s`$, $`C_b`$ and $`C_{cv}`$ are the statistical error, the residual systematics, and the cosmic variance, respectively, computed by the procedures described below. The statistical error was computed from the 100 randomized realizations catalog. Figure 5 shows the cross-correlation coefficient for the statistical noise for three scales, 2.5, 6.3, and 20 arcmin, with other scales. The non-zero B mode variance could indicate the existence of a residual systematic, although its origin is not yet clear. It would be natural to consider that a residual systematic of similar size also exists in the E mode. However, there is not yet a clear scheme to deal with this residual systematic. Therefore, we adopt the simple and conservative procedure described in Van Waerbeke (2002). We quadratically add the B mode variance to the error of the signal. As the E and B mode covariance matrices for the statistical noise are identical, the diagonal part of the matrix $`C_b`$ is given by the B mode signal and off-diagonal terms follow the same correlation properties as the E mode.

Estimation of the cosmic variance is more complicated, because the observed scales are in the quasi-linear to nonlinear regime and thus random Gaussian theory cannot be applied. The cosmic variance is estimated using weak lensing numerical experiments, which are performed using a ray-tracing technique combined with large $`N`$-body simulations; the details are described in Hamana et al. (in preparation; see also Menard et al. 2003; Takada & Hamana 2003). Briefly, the dark matter distribution from the observer ($`z=0`$) to high $`z`$ ($`z3`$) is generated by stacking 10 snapshot outputs from the $`N`$-body simulations. $`N`$-body data from the Very Large Simulation (VLS) which followed $`512^3`$ particles in a cubic box of 479$`h^1`$Mpc on a side, carried out by the Virgo Consortium (Jenkins et al. 2001; Yoshida, Sheth & Diaferio 2001) are used. A $`\mathrm{\Lambda }`$CDM model ($`\mathrm{\Omega }_m=0.3`$, $`\mathrm{\Omega }_\lambda =0.7`$ and $`h=0.7`$) is assumed with the CDM initial power spectrum computed using CMBFAST (Seljak & Zaldarriaga 1996). The multiple-lens plane ray-tracing algorithm is used to follow the light rays (Hamana & Mellier 2001, see also Jain, Seljak & White 2000 for the basic theory). The lensing convergence and shear is computed for 10242 pixels with a pixel size of 0.25 arcmin for a single source plane of $`z_s=1`$. We compute the covariance matrix due to the cosmic variance from 36 random mock observations (but without the intrinsic ellipticity of galaxy images) generated by the numerical experiment. As the ratio of the non-Gaussian to Gaussian contributions to cosmic variance does not vary significantly with the underlying cosmology (Van Waerbeke et al. 2002), the cosmic variance also does not play an important role at all scales; given the large residual error from the B mode variance at large scales, we use the covariance matrix obtained from the $`\mathrm{\Lambda }`$CDM numerical experiment regardless of the cosmological model considered. Figure 6.2 shows the aperture mass variance with error bars from the statistical error only (the left error bar on each point) and a sum of the statistical, systematic and cosmic variance in quadrature (the right error bar). On small scales, statistical error dominates \[the statistical error (left) is comparable to the total error (right)\], while at large scales the systematic error dominates given the large B mode variance.

### 6.3 Results and discussion

Here, we present two-parameter space constraints obtained from marginalizations over the two remaining parameters. Figure 6.2 shows the likelihood map on the $`\mathrm{\Gamma }`$-$`\overline{z}_s`$ plane where the default prior is applied for $`\mathrm{\Omega }_\mathrm{m}`$ and $`\sigma _8`$. This Figure clearly presents the correlation between $`\mathrm{\Gamma }`$ and $`\overline{z}_s`$; that is, a flatter (steeper) power spectrum (a larger (smaller) $`\mathrm{\Gamma }`$) prefers a lower (higher) $`\overline{z}_s`$, (this was reported previously by Van Waerbeke et al. 2002). The message here is that, given a relatively narrow range of signal detection ($`2\mathrm{}<\theta _{ap}<40\mathrm{}`$) with large error bars (as shown in Figure 6.2), the slope of the power spectrum and its normalization are degenerate. Similar considerations apply to a constraint on $`\sigma _8`$-$`\mathrm{\Gamma }`$, as shown in the lower left panel of Figure 6.3. Although the constraint on $`\mathrm{\Gamma }`$ and $`\overline{z}_s`$ is not as tight, we can see from Figure 6.2 that for $`\overline{z}_s>0.9`$ ($`>0.7`$) a flatter power spectrum with $`\mathrm{\Gamma }>0.5`$, would be ruled out at more than the 68% confidence level for the flat (open) model.

Figure 6.3 shows the degeneracy among the four parameters. The left panels clearly show the strong degeneracy between $`\sigma _8`$ and $`\overline{z}_s`$ (or $`\mathrm{\Gamma }`$). From these plots the following two points become clear: (i) redshift information about the source galaxies is crucial to obtaining a tight constraint on $`\sigma _8`$ (Bernardeau et al. 1997; Jain & Seljak 1997). (ii) A constraint on $`\mathrm{\Gamma }`$ from other independent observations (such as galaxy clustering and/or CMB anisotropies) is very useful to break the degeneracy among the parameters. The right panels of Figure 6.3 show the same likelihood maps but for $`\mathrm{\Omega }_\mathrm{m}`$. The constraints on $`\mathrm{\Omega }_\mathrm{m}`$ are weaker than those on $`\sigma _8`$, because the cosmic shear correlation is less sensitive to $`\mathrm{\Omega }_\mathrm{m}`$ than $`\sigma _8`$ (Bernardeau et al. 1997; Jain & Seljak 1997).

In addition to the default prior, we adopt other priors from information obtained from other observations. We estimate the mean redshift of our galaxy catalog using redshift distributions from other deep surveys. The redshift distributions of faint galaxies in the Hubble Deep Fields North and South have been estimated using spectroscopic and photometric redshift techniques by several groups (Fernández-Soto et al. 1999; Cohen et al. 2000; Fontana et al. 1999; 2000; Yahata et al. 2000). Note that there is a small discrepancy between the two datasets, which is probably due to field-to-field variation. If we assume that our galaxy catalog has a similar redshift distribution to the Hubble Deep Field data, the mean redshift of our catalog ($`22.5<R_c<26`$) is estimated to be larger than $`z=1`$. On the other hand, the redshift distribution of galaxies in the Subaru deep survey field has been estimated using the photometric redshift technique with $`BVR_ci^{}z^{}`$ data (Furusawa 2002; Furusawa et al. in preparation, see also Kashikawa et al. 2003). They found that the mean redshift of faint galaxies ($`R>24`$) is systematically lower than the HDF data. Note that the discrepancy is not very significant, given the large error bars due to small-number statistics. If we take the redshift distribution of the Subaru deep survey data, the median redshift of our catalog can be as low as $`z=0.7`$. The difference between these two estimates suggests that the field-to-field variation can be quite large. It is also important to take into account that the weighting of galaxies might change the redshift distribution in a non-trivial manner. Considering these points, we adopt a conservative constraint of $`\overline{z}_s[0.6,1.4]`$, and two tighter constraints of $`\overline{z}_s[0.6,1.2]`$ and $`\overline{z}_s[0.8,1.4]`$ to determine the impact of the source redshift information. We constrain $`\mathrm{\Gamma }`$ using the studies of galaxy clustering by the SDSS (Dodelson et al. 2002; Szalay et al. 2001) and the APM survey (Eisenstein & Zaldarria 2001). As there is a wide dispersion in $`\mathrm{\Gamma }`$ values among these studies, whereas the statistical error bars in each measurement are small, we adopt a conservative constraint, $`\mathrm{\Gamma }[0.1,0.4]`$, which covers the 68% confidence intervals of these three studies. We also take an extreme constraint of $`\mathrm{\Gamma }=0.21`$, where the 68% confidence intervals of the three studies overlap, to determine how well independent information on $`\mathrm{\Gamma }`$ improves the constraint on $`\mathrm{\Omega }_\mathrm{m}`$ and $`\sigma _8`$.

Figure 6.3 shows the constraint on $`\mathrm{\Omega }_\mathrm{m}`$ and $`\sigma _8`$ obtained from marginalization over $`\mathrm{\Gamma }[0.1,0.4]`$ and $`\overline{z}_s[0.6,1.4]`$. As expected, a strong degeneracy between $`\mathrm{\Omega }_\mathrm{m}`$ and $`\sigma _8`$ is found. The confidence intervals of $`\mathrm{\Omega }_\mathrm{m}`$ and $`\sigma _8`$ from various priors are summarized in Table 1. It is clear from this Table that information about the redshift distribution of galaxies and $`\mathrm{\Gamma }`$ can indeed give a tighter constraint on $`\mathrm{\Omega }_\mathrm{m}`$ and $`\sigma _8`$. Although the current constraint is not very tight, we may rule out the following two models.The COBE normalized high density CDM model (Bunn & White 1997, i.e., $`\mathrm{\Omega }_\mathrm{m}=1`$, $`\mathrm{\Omega }_\lambda =0`$, $`\sigma _8=1.2`$) is ruled out at more than the 99.9% confidence level. This model predicts too high an amplitude at all scales. For the open model, low density models with $`\mathrm{\Omega }_\mathrm{m}<0.2`$ are ruled out at more than the 68% confidence level. As pointed out by Van Waerbeke et al. (2002; see also Schneider et al. 1998), the incompatibility is because such low density models predict very large power at small scales. We obtain the following fitting function for the 95% confidence contours plotted in Figure 6.3,

$$\sigma _8=(0.50_{0.16}^{+0.35})\mathrm{\Omega }_\mathrm{m}^{0.37},\text{for }\mathrm{\Omega }_\mathrm{m}+\mathrm{\Omega }_\mathrm{\Lambda }=1,$$
(21)
and

$$\sigma _8=(0.51_{0.16}^{+0.20})\mathrm{\Omega }_\mathrm{m}^{0.34},\text{for }\mathrm{\Omega }_\mathrm{\Lambda }=0.$$
(22)
Figure 6.3 shows the one-dimensional likelihood function for $`\sigma _8`$ in the currently popular flat $`\mathrm{\Lambda }`$CDM cosmological model with $`\mathrm{\Omega }_\mathrm{m}=0.3`$ ($`\mathrm{\Omega }_\mathrm{\Lambda }=0.7`$) and $`\mathrm{\Gamma }=0.21`$. The solid curve is for the prior $`\overline{z}_s[0.6,1.2]`$, while the dashed curve is for $`\overline{z}_s[0.8,1.4]`$. Specifically, the one-dimensional confidence intervals of $`\sigma _8`$ for the 95.4% level are: $`0.68<\sigma _8<1.33`$ for $`\overline{z}_s[0.6,1.2]`$, $`0.62<\sigma _8<1.02`$ for $`\overline{z}_s[0.8,1.4]`$, and $`0.62<\sigma _8<1.32`$ for $`\overline{z}_s[0.6,1.4]`$. A strong degeneracy between $`\sigma _8`$ and $`\overline{z}`$ is evident. Especially, the upper bound of the $`\sigma _8`$ confidence interval is very sensitive to the choice of the lower limit of the mean redshift. This is also seen in the upper left panel of Figure 6.3. From these results we may say that, for the flat $`\mathrm{\Lambda }`$CDM cosmological model, we obtain a relatively reliable lower bound of $`\sigma _8>0.62`$ (95.4% confidence) for a reasonable choice of $`\overline{z}_s`$. However, the upper limit is uncertain; it depends strongly on the choice of the mean redshift. A conservative conclusion is $`\sigma _8<1.33`$ (95.4% confidence), but it is tightened by $`\sigma _8<1.02`$ if the mean redshift is as large as $`\overline{z}_s=0.8`$.

Our results are broadly consistent with constraints obtained from other cosmic shear surveys (Maoli et al. 2001; Bacon et al. 2002; Van Waerbeke et al. 2002; Hoekstra et al. 2002b; Refregier, Rhodes & Groth 2002; Brown et al. 2003; Jarvis et al. 2003). This consistency is remarkable, given that the data have been compiled from different instruments, filters and survey depths. However, there is a spread of confidence intervals among the surveys. In fact, Bacon et al.(2002) and Van Waerbeke et al. (2002) obtained a slightly higher normalization, $`\sigma _80.95`$ for the $`\mathrm{\Lambda }`$CDM model, which is incompatible with our 68.3% confidence interval for $`\overline{z}_s[0.8,1.4]`$. Note that Bacon et al.(2002) did not decompose the shear correlation function into E and B modes. Thus, their correlation function could be biased on the high side. The source of the small discrepancy among the cosmic shear surveys is unclear: it could be field-to-field variance, it could arise from the different analysis schemes, or it could be due to a mis-choice of the redshift distribution of galaxies. Hirata & Seljak (2003) investigated biases induced by the conversion between the observed image shape to shear distortion in current weak lensing analyses. They found that the non-Gaussianity of the point spread function has a significant effect and can lead to up to a 15% error in $`\sigma _8`$ depending on the method of analysis. A wider field, multi-color survey, and an analysis scheme calibrated using mock observations (as reported by Erben et al. 2000) are needed to improve the accuracy of the cosmic shear analysis.

It is interesting to compare our results with the $`\sigma _8`$ values obtained from the number density of rich clusters of galaxies published by many other groups. It should, however, be emphasized that there is a large dispersion in $`\sigma _8`$ values among these studies, whereas the errors in each measurement are quite small. The $`\sigma _8`$ values reported range from $`\sigma _80.7`$ (e.g., Borgani et al. 1999; 2001; Seljak 2002; Vianna, Nichol & Liddle 2002) to $`\sigma _80.9`$ (e.g., Eke, Cole & Frenk, 1996; Kitayama & Suto 1996; 1997; Bahcall & Fan 1998; Pen 1998; Pierpaoli et al. 2001) for the standard $`\mathrm{\Lambda }`$CDM model.

This spread may reflect mainly the uncertainty in the relation between the mass and X-ray temperature of clusters. If we take the prior of $`\overline{z}_s[0.6,1.4]`$, both values are well within our 95.4% confidence interval. However, larger $`\sigma _8`$ values are not preferred by the constraint obtained from the high-$`\overline{z}_s`$ prior, but are well within the 95.4% confidence interval of the low-$`\overline{z}_s`$ prior. Thus, if the mean redshift of our galaxy catalog is as high as that estimated from the HDF data ($`\overline{z}_s1`$), our result is more in accord with the lower $`\sigma _8`$ value.

Recently, Spergel et al. (2003) combined CMB measurements from WMAP (Bennet et al. 2003 and references therein), CBI (Person et al. 2002) and ACBAR (Kuo et al 2002), the galaxy power spectrum from the 2dF galaxy redshift survey (Percival et al. 2001; Verde et al. 2002), and the measurements of the Lyman $`\alpha `$ power spectrum (Croft et al. 2002; Gnedin & Hamilton 2002) to find the best fit cosmological model and obtained $`\sigma _8=0.84\pm 0.04`$ (68% confidence). This result is in good agreement with our cosmic shear constraints.

## 7 Summary

We analyzed the Suprime-Cam 2.1 deg2 $`R_c`$-band data and measured the cosmic shear correlation. Suprime-Cam has a wide field of view of $`34\mathrm{}\times 27\mathrm{}`$, and its superb imaging quality provides a very small RMS value of star ellipticities of 2.8%, which after PSF corrections is reduced to 1.0%. These advantages combined with the large light gathering power of the 8.2-m Subaru telescope make Suprime-Cam an almost ideal camera for a weak lensing survey.

For the cosmic shear correlation measurement we used galaxies with $`22.5<R_c<26`$ and an image size larger than the seeing size. We detected a non-zero cosmic shear two-point correlation function of up to 40′. However, this result may be contaminated by shear that is not caused by gravitational lensing. We thus adopted the aperture mass variance, which naturally decomposes the correlation signal into E and B modes (the latter arises from shear whose origin is not in gravitational lensing).

We detected a non-zero E mode variance on scales from $`\theta _{ap}=2\mathrm{}`$ to 40′. As the aperture mass probes a scale of $`\theta _{ap}/5`$, the signals come from effective scales of $`0.5\mathrm{}<\theta <10\mathrm{}`$, corresponding to the quasi-linear to nonlinear regimes. We also detected a small but non-zero B mode variance on scales larger than $`\theta _{ap}>5\mathrm{}`$. Currently, the origin of this B mode variance is not clear. One possibility is an incorrect anisotropic PSF correction. To test this possibility, we repeated the anisotropic PSF correction using different procedures (see the Appendix for details), namely: (i) a second order bi-polynomial fit to PSF, (ii) a pointing-by-pointing correction without masking overlapped regions and (iii) using fainter stars for modeling the PSF anisotropy. We did not find significant problems in our PSF correction procedure.

Interestingly, the amplitude of the B mode variance on larger scales is similar to that found by Van Waerbeke et al. (2002), though their survey depth was slightly shallower than ours. On the other hand, Hoekstra et al. (2002b) found a vanishing B mode variance on scales larger than 10 arcmin in their shallow data ($`R_c<24`$). These results may suggest that the current procedures for galaxy shape correction become problematic for fainter objects. Future detailed studies of the origin of the B mode shear are required to understand and suppress this possible source of residual systematic error. Also, a calibration of the analysis scheme using mock data is needed to improve the accuracy of the cosmic shear analysis.

We performed a maximum likelihood analysis in a four-dimensional space of $`\sigma _8`$, $`\mathrm{\Omega }_\mathrm{m}`$, $`\mathrm{\Gamma }`$ and $`\overline{z}_s`$. We included three possible sources of error: the statistical noise, the cosmic variance, and the residual systematic estimated from the B mode variance. We derived joint constraints on two parameters by marginalizing over the two remaining parameters. We obtained a weak upper limit of $`\mathrm{\Gamma }<0.5`$ for $`\overline{z}_s>0.9`$ (68% confidence). We also showed that independent information on $`\mathrm{\Gamma }`$ can reduce the degeneracy among the parameters. For the prior $`\mathrm{\Gamma }[0.1,0.4]`$ and $`\overline{z}_s[0.6,1.4]`$, we found $`\sigma _8=(0.50_{0.16}^{+0.35})\mathrm{\Omega }_\mathrm{m}^{0.37}`$ for $`\mathrm{\Omega }_\mathrm{m}+\mathrm{\Omega }_\mathrm{\Lambda }=1`$ and $`\sigma _8=(0.51_{0.16}^{+0.29})\mathrm{\Omega }_\mathrm{m}^{0.34}`$ for $`\mathrm{\Omega }_\mathrm{\Lambda }=0`$ (95.4% confidence). Although the current constraint is not very tight, we can rule out the following two models: the COBE normalized high density CDM model ($`\mathrm{\Omega }_\mathrm{m}=1`$, $`\mathrm{\Omega }_\lambda =0`$, $`\sigma _8=1.2`$) by more than a 99.9% confidence level, and low density open models ($`\mathrm{\Omega }_\mathrm{m}<0.2`$) by more than 68% confidence. If we take the currently popular $`\mathrm{\Lambda }`$CDM model ($`\mathrm{\Omega }_\mathrm{m}=0.3`$, $`\mathrm{\Omega }_\lambda =0.7`$, $`\mathrm{\Gamma }=0.21`$), we obtain a one-dimensional confidence interval on $`\sigma _8`$ for the 95.4% level, $`0.62<\sigma _8<1.32`$ for $`\overline{z}_s[0.6,1.4]`$. This result is broadly consistent with constraints from other cosmic shear surveys and from the cluster abundance. However, we found that the confidence interval is sensitive to the choice of the mean redshift: $`0.68<\sigma _8<1.33`$ for the prior of $`\overline{z}_s[0.6,1.2]`$, while $`0.62<\sigma _8<1.02`$ for $`\overline{z}_s[0.8,1.4]`$. The latter is incompatible with the higher $`\sigma _8`$ values obtained from some cluster abundance studies. This result clearly demonstrates that information on the redshift distribution of the source galaxies is crucial and can significantly tighten the confidence interval of $`\sigma _8`$ and $`\mathrm{\Omega }_\mathrm{m}`$. The improvement of the constraint on $`\sigma _8`$ from the redshift information can be estimated as follows: the cosmic shear correlation roughly scales with $`\sigma _8`$ and the mean redshift as $`\xi \sigma _8^{2.5}z_s^{1.5}`$, thus the uncertainly in the median redshift contributes to the error in $`\sigma _8`$ as $`\delta \sigma _8/\sigma _8=0.6\delta z_s/z_s`$. Therefore, the error in $`\sigma _8`$ due to uncertainly in the median redshift can be reduced to 10% by the current photometric redshift technique (e.g., Bolzonella, Miralles & Pelló 2000).

We would like to thank Y. Mellier for useful discussions and comments on the manuscript and L. Van Waerbeke for helpful discussions about galaxy shape analysis. We also thank the anonymous referee for detailed and constructive comments on an earlier manuscript, which improved the paper. T.H. thanks K. Umetsu and T. Futamase for useful discussions. T.H. F.N. and M.O. acknowledge support from Research Fellowships of the Japan Society for the Promotion of Science.

## Appendix A Anisotropic PSF correction

In §5, we found a small but non-zero B mode aperture mass variance on scales larger than 5 arcmin. Currently, the origin of this B mode variance is not clear. One possibility is an incorrect anisotropic PSF correction. To test this possibility, we repeated the anisotropic PSF correction, but adopting different procedures:

1. use a second order bi-polynomial fit to $`(P_{sm}^{})^1𝒆_{𝒐𝒃𝒔}^{\mathbf{}}`$.
2. use the pointing-by-pointing correction without masking the overlapping regions.
3. use fainter stars for modeling the PSF anisotropy.

First, we repeated the anisotropic PSF correction adopting a second order bi-polynomial fit (the primary analysis uses a first order fit). In this case, we found that both the E and B mode aperture mass variances are almost identical to the results from our primary data, the differences are $`1\times 10^6`$ at largest. Further, higher order fits are not feasible, because of the small number of stars in some chips. Note that Van Waerbeke et al. (2002) reported that a higher order polynomial fit to the PSF (third order in their case) caused a wing at the edge of fields and produced an artificial B mode signal.

Second, we applied the anisotropic PSF correction not to each chip separately but to each pointing, which is composed of ten chips (see Miyazaki et al. 2002 for instrumental details of Suprime-Cam). In this case, we did not mask the overlapping regions between different CCD chips that result from stacking dithering exposures. The second and fifth order bi-polynomial fits were adopted. No significant differences were found in either the E or B mode variances between the second and fifth order corrections. The E mode variance is consistent with our primary data (plotted in Figure 5). The amplitude of B mode variance is also similar to the primary data, but there is a bump at $`6\mathrm{}<\theta _{ap}<15\mathrm{}`$. This scale is translated into a real scale of $`1\mathrm{}<\theta <2\mathrm{}`$, which corresponds to the dithering angles between exposures. Thus, it is very likely that the bump arises from an inaccurate PSF correction at the overlapping regions where the PSF anisotropy pattern becomes very irregular111A similar B mode excess is found in CFHT data (L. Van Waerbeke & Y. Mellier, private communication).. Because of this result, we decided to mask the overlapping regions. Also, we decided to adopt the chip-by-chip correction to avoid poor modeling of the anisotropic PSF due to discontinuities between the chips.

Finally, we repeated the PSF correction but adopted slightly fainter stars to test the possibility of different responses to the PSF between bright and faint stars. Stars in the magnitude range $`21.5<R_c<23.5`$ were used for the PSF correction with the first order fit ($`20.6<R_c<23.0`$ for the primary procedure). The number of stars selected is almost the same as the primary selection ($`1/`$arcmin2). Both the E and B mode variance from these data are consistent with the primary data (specifically the results are within the error bars of the primary data). A much fainter criterion for star selection gives a poor PSF model because of contamination by small galaxies. Thus, it gives a very poor PSF correction.

In conclusion, as far as can be determined from the tests, we did not find a significant problem with our PSF correction procedure. A future detailed examination of the PSF correction method should be carried out using realistic simulation data, similar to the exercise performed by Erben et al. (2001). These tests, however, are beyond the scope of this paper and will be reported elsewhere.


format: text

text:
# Lagrangian surfaces with circular ellipse of curvature in complex space forms

## 1 Introduction

An interesting notion that comes up in the study of surfaces in higher codimension is that of the ellipse of curvature. This is the image in the normal space of the unit circle in the tangent plane under the second fundamental form.

Using this concept, I.V. Guadalupe and L. Rodriguez obtained in \[GR\] some inequalities relating the area of compact surfaces in (real) space forms and the integral of the square of the norm of the mean curvature vector with topological invariants. When the ellipse of curvature is a circle, restrictions on the Gaussian and normal curvatures gave them some rigidity results. (See Remark 2 in the paper).

M.F. Atiyah and H.B. Lawson showed (see Remark 1 in \[GR\]) that an immersed surface in the 4-sphere $`𝕊^4`$ has the ellipse always a circle if and only if the canonical lift of the immersion into the bundle of almost complex structures of $`𝕊^4`$ is holomorphic. Holomorphic curves in this twistor space of $`𝕊^4`$ can also be projected down to $`𝕊^4`$ in order to obtain examples of surfaces in $`𝕊^4`$ verifying that the ellipse of curvature is always a circle.

Other works which use the ellipse of curvature as a tool in the study of surfaces in (real) space forms can be found in \[MRR\], \[R\], \[V\] and \[W\].

In this article we attach the circular ellipse of curvature condition to Lagrangian surfaces in complex space forms. Here a complex space form means the complex projective plane $`^2`$, the complex Euclidean plane $`^2`$ or the complex hyperbolic plane $`^2`$, endowed with their canonical structures of Kaehler surfaces. An isometric immersion of a surface in a complex space form $`N(c)`$ is Lagrangian if the complex structure of $`N(c)`$ carries each tangent plane into the corresponding normal plane.

There exist many interesting Lagrangian surfaces in complex space forms. F. Urbano and the author recovered a classical example in Symplectic Geometry, known as the Whitney sphere, given (up to translations and scaling) by

(1)
$$\mathrm{\Phi }:𝕊^2^2,\mathrm{\Phi }(x,y,z)=\frac{1+iz}{1+z^2}(x,y),$$

showing that, from a Riemannian point of view, this Lagrangian sphere plays the role of the round sphere in the Lagrangian setting (see \[CU1\]).

Also, in \[CU3\], F. Urbano and the author completely classified all the twistor holomorphic Lagrangian immersions in the complex projective plane $`^2`$ (resp. in the complex hyperbolic plane $`^2`$), i.e. those Lagrangian immersions such that their twistor lifts to the twistor space over $`^2`$ (resp. over $`^2`$) are holomorphic. (Later the classification of the twistor harmonic ones was obtained in \[CU4\]).

The first classification provided a one-parameter family of examples of Lagrangian spheres in $`^2`$, given by

(2)
$$\begin{array}{c}\mathrm{\Phi }_t:𝕊^2^2,t0,\\ \mathrm{\Phi }_t(x,y,z)=\left[\frac{1}{c_t^2+s_t^2z^2}(c_tx,s_txz,c_ty,s_tyz,z,s_tc_t(1+z^2))\right],\end{array}$$

(with $`c_t=\mathrm{cosh}t`$, $`s_t=\mathrm{sinh}t`$). We observe that $`\mathrm{\Phi }_0`$ is the totally geodesic Lagrangian immersion of $`𝕊^2`$ in $`^2`$. In $`^2`$, we got a bigger family of examples:

(3)
$$\begin{array}{c}\widehat{\mathrm{\Phi }}_t:𝕊^2^2,t>0,\\ \widehat{\mathrm{\Phi }}_t(x,y,z)=\left[\frac{1}{s_t^2+c_t^2z^2}(s_tx,c_txz,s_ty,c_tyz,z,s_tc_t(1+z^2))\right];\end{array}$$

(4)
$$\begin{array}{c}\mathrm{\Psi }_s:^{}^2,s[0,\pi /4[,\\ \mathrm{\Psi }_s(z)=\left[\frac{1}{|w(z)|^2}(\mathrm{cos}^2sz^2\mathrm{sin}^2s\overline{z}^2,\frac{|z|^21}{\sqrt{2}}w(z),\frac{|z|^2+1}{\sqrt{2}}w(z))\right],\end{array}$$

where $`w(z)=\mathrm{cos}sz+\mathrm{sin}s\overline{z}`$; and

(5)
$$\begin{array}{c}\eta :^2,\eta (x,y)=\\ \left[\frac{1}{1+4x^2}(2y,4xy,2x4x^34xy^2,6x^2+2y^2,1+6x^2+2y^2,4x^3+4xy^2)\right].\end{array}$$

It is a well known fact that Lagrangian immersions in $`^2`$ (resp. in $`^2`$) are —locally— projections by the Hopf fibration $`\mathrm{\Pi }:𝕊^5^2`$ (resp. $`\mathrm{\Pi }:_1^5^2`$) of horizontal immersions in the unit sphere $`𝕊^5`$ (resp. in the anti-De Sitter space $`_1^5`$). Above $`[]`$ means image under these Hopf fibrations.

Both families (2) and (3) are also called Whitney spheres in \[CMU\] because of their geometric properties, similar to the classical Whitney spheres in $`^2`$. Examples (4) and (5) are complete Lagrangian embeddings with zero total curvature. All these examples (2)–(5) were studied by B.Y. Chen and L. Vrancken in a different context (see \[CV\]).

Making use of the mentioned results and after detecting a simple close relationship between the ellipse of curvature and some differential forms naturally associated to a Lagrangian surface, we prove in Theorem 1 that the only Lagrangian orientable surfaces with circular ellipse of curvature in complex space forms are the minimal ones and (open subsets of) the examples (1), (2), (3), (4) and (5).

Among the main consequences of this Theorem we emphasize the following new characterizations (Corollary 1) of the examples (1), (2) and (3):

> 1. The Whitney spheres $`\mathrm{\Phi }:𝕊^2^2`$ are the only Lagrangian compact orientable surfaces with circular ellipse of curvature in complex Euclidean plane.
> 2. The Whitney spheres $`\mathrm{\Phi }_t:𝕊^2^2,t>0,`$ are the only non minimal Lagrangian compact orientable surfaces with circular ellipse of curvature in the complex projective plane.
> 3. The Whitney spheres $`\widehat{\mathrm{\Phi }}_t:𝕊^2^2,t>0,`$ are the only Lagrangian compact orientable surfaces with circular ellipse of curvature in the complex hyperbolic plane.

In $`^2`$, we also determine the Clifford torus in terms of the circular ellipse of curvature condition and a pinching on its radius function (Corollary 2).

## 2 Preliminaries

Let $`\varphi :\mathrm{\Sigma }N`$ be an immersion of a surface $`\mathrm{\Sigma }`$ into a 4-dimensional Riemannian manifold $`N`$. We denote the metric of $`N`$ as well as the induced metric in $`\mathrm{\Sigma }`$ by $`,`$. If $`\sigma :T\mathrm{\Sigma }\times T\mathrm{\Sigma }T^{}\mathrm{\Sigma }`$ is the second fundamental form of $`\varphi `$, the ellipse of curvature is the subset of the normal plane defined as $`\{\sigma (v,v)T_p^{}\mathrm{\Sigma }:v,v=1,vT_p\mathrm{\Sigma },p\mathrm{\Sigma }\}`$. To see that it is an ellipse, we consider an arbitrary orthogonal tangent frame $`\{e_1,e_2\}`$, denote $`\sigma _{ij}=\sigma (e_i,e_j)`$, $`i,j=1,2`$, and look at the following formula for $`v=\mathrm{cos}\theta e_1+\mathrm{sin}\theta e_2`$:

(6)
$$\sigma (v,v)=H+\mathrm{cos}2\theta \frac{\sigma _{11}\sigma _{22}}{2}+\mathrm{sin}2\theta \sigma _{12},$$

where $`H=1/2`$ trace $`\sigma `$ is the mean curvature vector. As $`v`$ goes once around the unit tangent circle, $`\sigma (v,v)`$ goes twice around the ellipse, which could degenerate into a line segment or a point. The center of the ellipse is $`H`$. $`\varphi `$ is said to be minimal if $`H0`$.

From (6) it is not difficult to deduce that the ellipse of curvature is a circle if and only if

(7)
$$\frac{|\sigma _{11}\sigma _{22}|^2}{4}=|\sigma _{12}|^2,\sigma _{11}\sigma _{22},\sigma _{12}=0.$$

The property that the ellipse is a circle is a conformal invariant.

We consider now that the target manifold $`N`$ is a simply connected complex space form with complex structure $`J`$ and constant holomorphic sectional curvature $`c`$. We denote by $`N(c)`$ the complex projective plane $`^2`$ if $`c=4`$, the complex Euclidean plane $`^2`$ if $`c=0`$ and the complex hyperbolic plane $`^2`$ if $`c=4`$, with their standard complex structures and metrics. An immersion $`\varphi :\mathrm{\Sigma }N(c)`$ is said to be Lagrangian (it is also used classically the nomenclature of totally real instead of Lagrangian) if $`JT_p\mathrm{\Sigma }=T_p^{}\mathrm{\Sigma }`$ for each point $`p`$ of $`M`$. In this case it is not hard to find that the trilinear form

$$C(u,v,w)=\sigma (u,v),J\varphi _{}(w)$$

is fully symmetric and, according to the Gauss equation of $`\varphi `$, $`K=c/4+\sigma _{11},\sigma _{22}|\sigma _{12}|^2`$, the Gauss curvature $`K`$ of a Lagrangian surface in $`N(c)`$ is given by

(8)
$$K=\frac{c}{4}+2|H|^2\frac{|\sigma |^2}{2}.$$

If the ellipse of curvature of a surface is always a circle, we can define its radius function $`R0`$ by means of $`R^2=(|\sigma _{11}\sigma _{22}|^2)/4=|\sigma _{12}|^2`$ taking into account (7). From (8), it is not complicated to obtain that the radius function of a Lagrangian surface with circular ellipse of curvature in a complex space form $`N(c)`$ is given by

(9)
$$R^2=\frac{1}{2}\left(\frac{c}{4}+|H|^2K\right).$$

## 3 Statements and proofs of the results

###### Theorem 1

Let $`\varphi :\mathrm{\Sigma }N(c)`$ be a Lagrangian immersion of an orientable surface $`\mathrm{\Sigma }`$ into a complex space form $`N(c)`$. The ellipse of curvature of $`\varphi `$ is always a circle if and only if either $`\varphi `$ is minimal or $`\varphi `$ is locally congruent to some of the immersions (1), (2), (3), (4) or (5).

###### Remark 1

The ellipse of curvature in a totally geodesic point degenerates into a point. This case can be thought as a circular ellipse of curvature with radius equal to zero.

Proof: We start defining a cubic differential form $`\mathrm{\Theta }`$ and a differential form $`\mathrm{{\rm Y}}`$ (see \[CU1\] and \[CU3\]) by

$$\begin{array}{c}\mathrm{\Theta }(z)=f(z)(dz)^3,f=4C(_z,_z,_z),\\ \\ \mathrm{{\rm Y}}(z)=h(z)dz,h=2C(_z,_{\overline{z}},_{\overline{z}})/_z,_{\overline{z}},\end{array}$$

where $`z=x+iy`$ is a local isothermal coordinate on $`\mathrm{\Sigma }`$ where the induced metric is written as $`,=e^{2u}|dz|^2`$ and $`,`$, $`J`$ and $`\sigma `$ are extended $``$-linearly to the complexified bundles. We note that $`2\sigma (_z,_{\overline{z}})=e^{2u}H`$.

We choose the orthonormal frame $`\{e_1=_x/e^u,e_2=_y/e^u\}`$ and put $`C_{ijk}=C(e_i,e_j,e_k)=\sigma (e_i,e_j),J\varphi _{}e_k`$, $`i,j,k\{1,2\}`$. We can now rewrite $`f`$ and $`h`$ as follows:

(10)
$$\begin{array}{c}f=\frac{e^{3u}}{2}[(C_{111}3C_{122})+i(C_{222}3C_{112})],\\ \\ h=\frac{e^u}{2}[(C_{111}+C_{122})+i(C_{112}+C_{222})].\end{array}$$

On the other hand, using again the symmetry of $`C`$, we obtain:

(11)
$$\begin{array}{c}\left|\sigma _{11}\sigma _{22}\right|^24|\sigma _{12}|^2=C_{111}^22C_{111}C_{112}\\ \\ 3C_{122}^23C_{112}^22C_{112}C_{222}+C_{222}^2,\\ \\ \sigma _{11}\sigma _{22},\sigma _{12}=C_{111}C_{112}C_{122}C_{222}.\end{array}$$

From (10) and (11) we get:

(12)
$$e^{4u}f\overline{h}=\left(\frac{|\sigma _{11}\sigma _{22}|^2}{4}|\sigma _{12}|^2\right)+i\sigma _{11}\sigma _{22},\sigma _{12}.$$

Using (7), we know that ellipse of curvature is a circle if and only if the right-side of the equality in (12) vanishes.

In \[CU1, Theorem 2\] and \[CU3, Theorems 1 and 2\] it was proved that the cubic differential $`\mathrm{\Theta }`$ is identically zero (i.e. $`f0`$) if and only if $`\varphi `$ is totally geodesic or $`\varphi (\mathrm{\Sigma })`$ is an open set of $`\mathrm{\Phi }(𝕊^2)`$ (see (1)) if $`c=0`$, of $`\mathrm{\Phi }_t(𝕊^2)`$ (see (2)) if $`c=4`$, of $`\mathrm{\Phi }_t(𝕊^2)`$ (see (3)), $`\mathrm{\Psi }_s(^{})`$ (see (4)) or $`\eta ()`$ (see (5)) if $`c=4`$. Moreover, $`\varphi `$ is minimal if and only if $`h0`$ since $`|h|^2=e^{2u}|H|^2`$.

A standard argument completes the proof of the theorem.

Minimal Lagrangian orientable surfaces in $`^2`$ can be represented as holomorphic curves in $`^2`$ by exchanging the orthogonal complex structure on $`^4`$ (cf. \[CM\]). In the case of $`^2`$ we emphasize the following result.

###### Theorem 2 (\[Y\], Theorem 7; \[NT\])

Let $`\varphi :\mathrm{\Sigma }^2`$ be a minimal Lagrangian immersion of a compact orientable surface. Then:

If $`\mathrm{\Sigma }`$ has genus zero, then $`\varphi `$ is totally geodesic and it is the standard immersion $`\mathrm{\Phi }_0`$ (see (2)) of $`𝕊^2`$ into $`^2`$.

If the genus of $`\mathrm{\Sigma }`$ is nonzero and the Gauss curvature $`K`$ is either nonnegative or nonpositive, then $`\mathrm{\Sigma }`$ is flat and $`\varphi `$ is the Clifford torus.

The Clifford torus is the quotient by the Hopf fibration of the isometric inclusion

$$𝕊^1(1/\sqrt{3})\times 𝕊^1(1/\sqrt{3})\times 𝕊^1(1/\sqrt{3})𝕊^5^3.$$

It was the only example of minimal Lagrangian torus in $`^2`$ during a long period. For subsequent progress in this matter we refer to \[CU2\] and \[MM\].

Using the well known fact that there do not exist compact minimal surfaces neither in $`^2`$ nor in $`^2`$, we deduce from Theorem 1 the following first immediate consequence.

###### Corollary 1

The Whitney spheres (1) (resp. (3)) are the only Lagrangian compact orientable surfaces with circular ellipse of curvature in the complex Euclidean plane (resp. in the complex hyperbolic plane). The Whitney spheres (2) are the only non minimal Lagrangian orientable compact surfaces with circular ellipse of curvature in the complex projective plane.

###### Remark 2

In \[CU1\] and \[CU3\] we obtained a different characterization of the Whitney spheres that can be written as follows:

Let $`\varphi :\mathrm{\Sigma }N(c)`$ be a Lagrangian immersion of a compact orientable surface $`\mathrm{\Sigma }`$ with Euler characteristic $`\chi (\mathrm{\Sigma })`$. Then:

$$_\mathrm{\Sigma }|H|^2𝑑A+\frac{c}{2}\mathrm{Area}(\mathrm{\Sigma })4\pi \chi (\mathrm{\Sigma }),$$

and the equality holds if and only if $`\varphi `$ is congruent to some of the Whitney spheres.

It is interesting to compare this result with Theorem 1 in \[GR\] since both follows a similar style.

On the other hand, O. Kasabov proved in \[K\] the following result: Let $`\varphi :\mathrm{\Sigma }N(c)`$ be a constant $`\lambda `$-isotropic Lagrangian immersion of a complete surface $`\mathrm{\Sigma }`$ into a complex space form $`N(c)`$. Then either $`\varphi `$ is totally geodesic or $`c>0`$ ($`c=4`$) and $`\varphi `$ is congruent to the Clifford torus.

The Lagrangian immersion $`\varphi `$ is said to be $`\lambda `$-isotropic ($`\lambda `$ being a constant) if for each unit vector $`v`$ tangent to $`\mathrm{\Sigma }`$ the length of $`\sigma (v,v)`$ is $`\lambda `$. In other words, $`\varphi `$ must be a minimal immersion whose radius function (of the circular ellipse of curvature, see (9)) is $`\lambda `$=constant. For example, the Clifford torus is $`1/\sqrt{2}`$-isotropic in $`^2`$. We for our part finish the paper showing the following alternative determination of the Clifford torus.

###### Corollary 2

Let $`\varphi :\mathrm{\Sigma }N(c)`$ be a Lagrangian immersion with circular ellipse of curvature and radius function $`R`$ of a compact orientable surface $`\mathrm{\Sigma }`$ into a complex space form $`N(c)`$.

If $`R1/\sqrt{2}`$, then $`c=4`$ and $`\varphi `$ is congruent to the Clifford torus.

Proof: From Theorem 1 and the compactness hypothesis, our immersion $`\varphi `$ must be minimal (necessarily in $`^2`$) or congruent to some of the examples (1), (2) or (3).

Using (8) and (9), if $`\varphi `$ is minimal its radius function $`R`$ is given by $`R^2=1/2(1K)=|\sigma |^2/4`$. But $`R1/\sqrt{2}`$ implies $`K0`$ and Theorem 2 says to us that $`\varphi `$ is the Clifford torus.

Otherwise, the cubic differential $`\mathrm{\Theta }`$ associated to a Whitney sphere vanishes identically (see the proof of Theorem 1). Since $`|f|^2=e^{6u}(c/2+|H|^22K)0`$, we deduce that $`R^2=1/2(Kc/4)`$ in this case. Now the hypothesis $`R1/\sqrt{2}`$ translates into $`K1`$ for (1), $`K2`$ for (2) and $`K0`$ for (3). But in \[CU1\] and \[CU3\] we studied the behavior of the Gauss curvature of the Whitney spheres showing:

The Gauss curvature $`K`$ of $`(𝕊^2,\mathrm{\Phi }^{},)`$ verifies $`0K1`$. Moreover, $`K(x,y,z)=0`$ (respectively $`K(x,y,z)=1`$) if and only if $`z=\pm 1`$ (respectively $`z=0`$).

The Gauss curvature $`K_t`$ of $`(𝕊^2,\mathrm{\Phi }_t^{},)`$ verifies $`1K_t1+2\mathrm{sinh}^2t`$. Moreover, $`K_t(x,y,z)=1`$ (respectively $`K_t(x,y,z)=1+2\mathrm{sinh}^2t`$) if and only if $`z=\pm 1`$ (respectively $`z=0`$).

The Gauss curvature $`K_t`$ of $`(S^2,\widehat{\mathrm{\Phi }}_t^{},)`$ verifies $`1K_t1+2\mathrm{cosh}^2t`$. Moreover, $`K_t(x,y,z)=1`$ (respectively $`K_t(x,y,z)=1+2\mathrm{cosh}^2t`$) if and only if $`z=\pm 1`$ (respectively $`z=0`$).

This is incompatible with our previous conclusion. So the second case is impossible.

| address: |
| --- |
| Departamento de Matemáticas |
| Escuela Politécnica Superior |
| Universidad de Jaén |
| 23071 Jaén |
| SPAIN |
| e-mail: |
| icastro@ujaen.es |