Introduction

Ultracold atomic and molecular systems with electric and magnetic dipolar interactions have become the research focus in cold atom physics1,2,3,4,5,6,7. When dipole moments are aligned by external fields, dipolar interactions exhibit the -type anisotropy. The anisotropic Bose-Einstein condensations of dipolar bosons (e.g. 52Cr) have been observed8,9,10,11. For the fermionic electric dipolar systems,40K-87Rb has been cooled down to nearly quantum-degeneracy3. Effects of the anisotropic electric dipolar interaction on the fermion many-body physics have been extensively investigated. In the Fermi liquid theory, both the single particle properties and collective excitations exhibit the anisotropy12,13,14,15,16,17. In the single-component Fermi systems, the leading order Cooper pairing instability lies in the p-wave channel, which is the simplest one allowed by Pauli's exclusion principle. The anisotropy of the electric dipolar interaction selects the instability in the pz-channel, which is slightly hybridized with other odd partial wave channels20,21,22,23,24,25,26,27. For two-component cases, the dipolar interaction leads to anisotropic spin-triplet pairing and its orbital partial wave is again in the pz-channel28,29,30,31. The triplet pairing competes with the singlet pairing in the hybridized -channel. The mixing between the singlet and triplet pairings has a relative phase , which leads to a novel time-reversal symmetry breaking Cooper pairing state29.

An important recent experimental progress is the laser cooling and trapping of magnetic dipolar fermions of 161Dy and 163Dy with large atomic magnetic moments (10µB)1,2. There are important differences between magnetic and electric dipolar interactions. Electric dipole moments are essentially non-quantized classic vectors from the mixing between different rotational eigenstates with opposite parities, which are induced by external electric fields3,4, thus electric dipoles are frozen. In the absence of external fields, even though at each instant of time there is a dipole moment of the heteronuclear molecule, it is averaged to zero at a long time scale. In contrast, magnetic dipole moments of atoms are intrinsic, proportional to their hyper-fine spins with a Lande factor. Unpolarized magnetic dipolar Fermi systems are available, in which dipoles are defrozen as non-commutative quantum mechanical operators, thus lead to richer quantum spin physics of dipolar interactions. Furthermore, the magnetic dipolar interaction is actually isotropic in the unpolarized systems. It is invariant under simultaneous spin-orbit rotations but not separate spin or orbit rotations. This spin-orbit coupling is different from usual single particle one, but an interaction effect. It plays an important role in the Fermi liquid properties such as the unconventional magnetic states and ferro-nematic states predicted by Fregoso et al18,19.

It is natural to expect that magnetic dipolar interaction brings novel pairing symmetries not studied in condensed matter systems before. The systems of 161Dy and 163Dy are with a very large hyperfine spin of , thus their Cooper pairing problem is expected to be very challenging. As a first step, we study the simplest case of spin- and find that the magnetic dipolar interaction provides a novel and robust mechanism to the p-wave (L = 1) spin triplet (S = 1) Cooper pairing to the first order of interaction strength, which comes from the attractive part of the magnetic dipolar interaction. In comparison, the p-wave triplet pairing in usual condensed matter systems, such as 3He32,33,34, is due to the spin-fluctuation mechanism, which is at the second order of interaction strength (see Refs.35,36 for reviews). This mechanism is based on strong ferromagnetic tendency from the repulsive part of the 3He-3He interactions. Furthermore, the p-wave triplet Cooper pairing symmetry patterns in magnetic dipolar systems are novel, which do not appear in 3He. The orbital and spin angular momenta of the Cooper pair are entangled into the total angular momentum J = 1, which is denoted as the J-triplet channel below. In contrast, in the 3He-B phase32, L and S are combined into J = 0; and in the 3He-A phase, L and S are decoupled and J is not well-defined32,34. There are two competing pairing possibilities in this J-triplet channel with different values of Jz: the helical polar state (Jz = 0) preserving time reversal (TR) symmetry and the axial state (Jz = ±1) breaking TR symmetry. The helical polar state has point nodes and gapless Dirac spectra, which is a time-reversal invariant generalization of the 3He-A phase with entangled spin and orbital degrees of freedom. In addition to usual phonon modes, its Goldstone modes contain the total angular momentum wave as entangled spin-orbital modes.

Results

We begin with the magnetic dipolar interaction between spin- fermions

where is the relative displacement vector between two fermions; µ is the magnitude of the magnetic moment. Such an interaction is invariant under the combined SU(2) spin rotation and SO(3) space rotation. In other words, orbital angular momentum and spin are not separately conserved, but the total angular momentum remains conserved. Its Fourier transformation reads19

The Hamiltonian in the second quantization form is written as

where ; µc is the chemical potential; is the pairing operator; the Greek indices α, β, α′ and β′ refer to ↑ and ↓; V is the volume of the system. We define a dimensionless parameter characterizing the interaction strength as the ratio between the characteristic interaction energy and the Fermi energy: .

We next study the symmetry of the Cooper pairing in the presence of Fermi surface, i.e., in the weak coupling theory. An important feature of the magnetic dipolar interaction in Eq. (1) is that it vanishes in the total spin singlet channel. Thus, we only need to study the triplet pairing in odd orbital partial wave channels. Considering uniform pairing states at the mean-field level, we set in Eq. (3) and define triplet pairing operators , which are eigen-operators of with eigenvalues sz = 0, ±1, respectively. More explicitly, they are , , . The pairing interaction of Eq. (3) reduces to

where

is the Clebsch-Gordan coefficient for two spin- states to form the spin triplet; and is an odd function of both and .

The decoupled mean-field Hamiltonian reads

where we only sum over half of the momentum space; and µch is the chemical potential; ; Δαβ is defined as . satisfies the mean-field gap function as

where . The integral in Eq. (7) is already normalized following the standard procedure20. For simplicity, we use the Born approximation in Eq. (7) by employing the bare interaction potential rather than the fully renormalized T-matrix, which applies in the dilute limit of weak interactions. The pairing symmetry, on which we are interested below, does not depend on the details that how the integral of Eq. (7) is regularized in momentum space. The Bogoliubov quasiparticle spectra become , where are the eigenvalues of the positive-definite Hermitian matrix . The free energy can be calculated as

where is the inverse of the interaction matrix defined as

We next linearize Eq. (7) around Tc and perform the partial wave analysis to determine the dominant pairing channel. Since the total angular momentum is conserved, we can use J to classify the eigen-gap functions denoted as . The index a is used to distinguish different channels sharing the same value of J. satisfies

where is the density of state at the Fermi surface; are dimensionless eigenvalues; , are at the Fermi surface. Then Eq. (7) is linearized into a set of decoupled equations

where is an energy scale at the order of the Fermi energy playing the role of energy cut-off from the Fermi surface.

The decomposition of into spherical harmonics can be formulated as

where L = L′ or L = L′±2 and L, L′ are odd numbers. The expressions of the dimensionless matrix elements are lengthy and will be presented elsewhere. By diagonalizing this matrix, we find that the most negative eigenvalues is wJ = 1 = −3πλ/4 lying in the channel with J = L = 1. All other negative eigenvalues are significantly smaller. Therefore, dominate pairing symmetry is identified as the J-triplet channel with L = S = 1 in the weak coupling theory. Following the standard method in Ref.20, the transition temperature Tc is expressed as . For a rough estimation of the order of magnitude of Tc, we set the prefactor in the expression of Tc as Ef.

In order to understand why the J-triplet channel is selected by the magnetic dipolar interaction, we present a heuristic picture based on a two-body pairing problem in real space. Dipolar interaction has a characteristic length scale adp = 2/2 at which the kinetic energy scale equals the interaction energy scale. We are not interested in solving the radial equation but focus on the symmetry properties of the angular solution, thus, the distance between two spins is taken fixed at adp. We consider the lowest partial-wave, p-wave, channel with L = 1. The 3 × 3 = 9 states (L = S = 1) are classified into three sectors of J = 0, 1 and 2. In each channel of J, the interaction energies are diagonalized as

respectively, where . Only the total angular momentum triplet sector with J = 1 supports bound states, thus is the dominant pairing channel and is consistent with the pairing symmetry in the weak-coupling theory.

This two-body picture applies in the strong coupling limit. Although a complete study of the strong coupling problem is beyond the scope of this paper, this result provides an intuitive picture to understand pairing symmetry in the J-triplet sector from spin configurations. We define that χµ and are eigenstates with eigenvalues zero for operators and , which are the total spin and orbital angular momenta projected along the eµ-direction. The J-triplet sector states are with φµ satisfying . For example,

where and and are eigenstates of with eigenvalues of ±1. As depicted in Fig. 1 A, along the equator where φz has the largest weight, two spins are parallel and along , thus the interaction is dominated by attraction. On the other hand, the eigenstate of J = 0 reads

where |αΩ〉 and |βΩ〉 are eigenstates of with eigenvalues ±1. As shown in Fig. 1 B, along any direction of , two spins are anti-parallel and longitudinal, thus the interaction is repulsive.

Figure 1
figure 1

The spin configurations of the two-body states with a) J = 1 and jz = 0 and b) J = jz = 0.

The interactions are attractive in a) but repulsive in b).

Let us come back to momentum space and study the competition between three paring branches in the J-triplet channel under the Ginzburg-Landau (GL) framework. We define

The bulk pairing order parameters are defined as , where no summation over µ is assumed. We define pairing parameters and their real and imaginary parts as the following 3-vectors . The GL free energy is constructed to maintain the U(1) and SO(3) rotational symmetry as

where

The sign of γ2 determines two different pairing structures: at γ2 > 0 and at γ2 < 0, respectively. Using the analogy of the spinor condensation of spin-1 bosons, the former is the polar pairing state and the latter is the axial pairing state37,38,39,40.

For the polar pairing state, the order parameter configuration can be conveniently denoted as up to a U(1) phase and SO(3)-rotation. This pairing carries the quantum number Jz = 0. The pairing matrix reads

It equivalents to a superposition of orbital configurations for spin-↑↑ (↓↓) pairs, respectively. Thus, this pairing state is helical. It is a unitary pairing state because is proportional to a 2×2 identity matrix. The Bogoliubov quasiparticle spectra are degenerate for two different spin configurations as with the anisotropic gap function depicted in Fig. 2. They exhibit Dirac cones at north and south poles with opposite chiralities for two spin configurations.

Figure 2
figure 2

The angular distribution of the gap function v.s.

cosθk in the helical polar pairing state (the red line) and the axial pairing state (the black line).

Similarly, the order parameter configuration in the axial pairing state can be chosen as up to the symmetry transformation. This state carries the quantum number of Jz = 1. The pairing matrix takes the form

This is a non-unitary pairing state since . The Bogoliubov quasiparticle spectra have two non-degenerate branches with anisotropic dispersion relations as . The angular gap distribution is depicted in Fig. 2. Each of branch 1 and 2 exhibits one node at north pole and south pole, respectively. Around the nodal region, the dispersion simplifies into , which is quadratic in the transverse momentum .

At the mean-field level, the helical polar pairing state is more stable than the axial state. Actually, this conclusion is not so obvious as in the case of 3He-B phase, where the isotropic gap function is the most stable among all the possible gap functions33. Here, the gap functions are anisotropic in both the polar and helical pairing phases. We need to compare them by calculating their free energies in Eq. (8). The second term contributes the same to both pairing phases. Thus, the first term determines the difference in free energies. Let us define the ratio between angular integrals of the free energy kernels in Eq. (8) of the two phases as

where , is numerically plotted in Fig. 3. For arbitrary values of β, ξk and |Δ|, y is always larger than 1. Therefore, the polar state is favored more than the axial state. This can be understood from the convexity of the nonlinear term in Eq. (8), which favors isotropic angular distributions of 42. Although neither gap function of these two states is absolutely isotropic as in the 3He-B phase, the polar gap function is more isotropic from Fig. 2 and thus is favored. However, we need to bear in mind that we cannot rule out the possibility that certain strong coupling effects can stabilize the axial state. In fact, the 3He-A phase can be stabilized under the spin feedback mechanism35, which is a higher order effect in terms of interaction strength.

Figure 3
figure 3

The ratio of the angular integrals of the free energy kernels , which is always larger than 1.

This means that the polar pairing is favored at the mean-field level.

Next we discuss the classification of Goldstone modes and vortices in these two states. In the helical polar state, the remaining symmetries are SOJ(2) × Z2 as well as parity and time-reversal (TR), where Z2 means the combined operation of rotation π around any axis in the xy-plane and a flip of the pairing phase by π. The Goldstone manifold is

The Goldstone modes include the phase phonon mode and two branches of spin-orbital modes. Vortices in this phase can be classified into the usual integer vortices in the phase sector and half-quantum vortices combined with π-disclination of the orientation of . In the axial state, the rotation around z-axis generates a shift of the pairing phase, which can be canceled by a Uc(1) transformation, thus, the remaining symmetry is . The Goldstone manifold is S2 × Uc(1). Only integer vortices exist.

Discussions

In summary, we have found that the magnetic dipolar interaction provides a robust mechanism at first order in the interaction strength for a novel p-wave (L = 1) spin triplet (S = 1) Cooper pairing state, in which the total angular momentum of the Cooper pair is J = 1. This is a novel pairing pattern which does not appear in 3He, and, to our knowledge, neither in any other condensed matter systems. These pairing states include the TR invariant helical polar pairing state and the TR breaking axial pairing state, both of which are distinct from the familiar 3He-A and B phases.

Many interesting questions are open for further exploration, including the topological properties of these pairing states, vortices, spin textures and spectra of collective excitations. The above theory only applies for spin- systems, in which the magnetic dipolar interaction is too small. For the pairing symmetry in a magnetic dipolar system with a large spin S, our preliminary results show that the basic features of the J-triplet pairing remains. The spins of two fermions are parallel forming Stot = 2S with orbital partial-wave L = 1 and the total J = 2S. In the current experiments in Ref.41, the highest attainable density reaches 4×1013 cm−1 for 161Dy atoms with . The corresponding dipolar energy is Eint ≈ 2 nK and the Fermi energy for unpolarized gases Ef ≈ 13.6 nK and thus λ = Eint/Ef ≈ 0.15. If we use the same formula of wJ = 1 above for an estimation of the most negative eigenvalue, we arrive at Tc/Tf ≈ 0.06, which means that Tc ≈ 0.8 nK. Although it is still slightly below the lower limit of the accessible temperature in current experiments, we expect that further increase of fermions density, say, in optical lattices will greatly increase Tc.

Method

We have used the methods of the symmetry analysis, strong coupling analysis, mean-field theory, partial-wave analysis and the Ginzburg-Landau free energy, which have been explained in Sec. I.