Get Our e-AlertsSubmit Manuscript
BME Frontiers / 2021 / Article

Review Article | Open Access

Volume 2021 |Article ID 3973857 | https://doi.org/10.34133/2021/3973857

Darian S. James, Paul J. Campagnola, "Recent Advancements in Optical Harmonic Generation Microscopy: Applications and Perspectives", BME Frontiers, vol. 2021, Article ID 3973857, 24 pages, 2021. https://doi.org/10.34133/2021/3973857

Recent Advancements in Optical Harmonic Generation Microscopy: Applications and Perspectives

Received27 Jul 2020
Accepted14 Dec 2020
Published15 Feb 2021

Abstract

Second harmonic generation (SHG) and third harmonic generation (THG) microscopies have emerged as powerful imaging modalities to examine structural properties of a wide range of biological tissues. Although SHG and THG arise from very different contrast mechanisms, the two are complimentary and can often be collected simultaneously using a modified multiphoton microscope. In this review, we discuss the needed instrumentation for these modalities as well as the underlying theoretical principles of SHG and THG in tissue and describe how these can be leveraged to extract unique structural information. We provide an overview of recent advances showing how SHG microscopy has been used to evaluate collagen alterations in the extracellular matrix and how this has been used to advance our knowledge of cancers, fibroses, and the cornea, as well as in tissue engineering applications. Specific examples using polarization-resolved approaches and machine learning algorithms are highlighted. Similarly, we review how THG has enabled developmental biology and skin cancer studies due to its sensitivity to changes in refractive index, which are ubiquitous in all cell and tissue assemblies. Lastly, we offer perspectives and outlooks on future directions of SHG and THG microscopies and present unresolved questions, especially in terms of overall miniaturization and the development of microendoscopy instrumentation.

1. Introduction

Multiphoton microscopy (MPM) has revolutionized biological imaging since its modern inception in the early 1990s, where the first breakthroughs utilized two-photon excited fluorescence (TPEF) to probe live cells and tissues [1]. This technology largely solved long-standing problems of confocal microscopy including photobleaching and penetration depth limitations. By the late 1990s, other nonlinear optical methods such as second harmonic generation (SHG) [2], third harmonic generation (THG) [3], and coherent anti-Stokes Raman scattering (CARS) [4] were demonstrated as viable biological imaging tools, with each providing its own unique and often complementary information content. While it is more common to pair SHG and TPEF microscopies given the vast array of engineered fluorescent proteins and autofluorescent extracellular matrix (ECM) proteins (e.g., elastin), combining SHG and THG microscopies also has its advantages. These include increased imaging depths due to longer excitation wavelengths and applicability to a wide range of tissues, even those that do not autofluoresce. For example, the sensitivity of THG to refractive index can give structural context for the SHG collagen contrast. Moreover, there are theoretical commonalities (further explained in Section 3) between the two modalities. Therefore, in this review, we will focus on the fundamental principles and emerging applications of SHG and THG microscopies.

2. SHG and THG Historical Origins and Overview of Current Uses

SHG is a nonlinear second-order coherent process where two lower energy photons are upconverted, emitting a photon at exactly twice the frequency of the incident excitation source (Figure 1(a)) [5]. Dr. Maria Goeppert-Mayer theoretically predicted SHG (along with two-photon excitation) in her 1931 PhD thesis [6], whereas the first experimental demonstrations were on quartz in 1961 following the development of the ruby laser [7]. While modern SHG biological imaging was reported in the late 1990s [8, 9], it is interesting to note that there were prior spectroscopic and low-resolution microscopy examinations of collagen in 1971 [10] and 1986 [11], respectively.

The initial interest in this contrast mechanism for biological microscopy was probing membrane potential in live cells using voltage-sensitive dyes [12], where it was shown that SHG afforded greater sensitivity than traditional fluorescence methods [5, 8, 13]. However, the larger majority of SHG microscopy has been performed on tissues for structural analysis and we will limit our scope to those applications [2, 14, 15].

SHG microscopy has now emerged as a powerful and widely used tool for high-resolution, high-contrast, three-dimensional imaging of tissues [16]. As will be described in detail in the theory section, SHG contrast requires non-centrosymmetric assemblies on the size scale of , which is ideal for imaging well-ordered structures such as fibrillar collagen (i.e., Col I, Col II, Col III, and Col V or mixtures thereof). Other structural proteins such as nonfibrillar collagen (i.e., Col IV), laminin, fibronectin, and elastin are transparent by this modality as this criterion is not met. While this may seem a large limitation, collagen is the primary protein component in the extracellular matrix (ECM) of many connective tissues including tendon [17], skin [18], cornea [19], blood vessels, and bone and also in stroma in internal organs such as ovary [20], cervix [21], lung [22], liver [23], and kidney [24]. Indeed, most SHG microscopy applications have focused on probing collagen changes in a wide range of pathologies involving these and other tissues and some of these studies will be reviewed here.

Similar to SHG, THG is a nonlinear coherent process where three photons are upconverted to produce a photon that is triple the frequency of the incident photon (Figure 1(a)). THG was first experimentally found in calcite, gases, and liquids, shortly after the demonstration of SHG [15]. During the late 1990s, high-resolution THG biological microscopy was first demonstrated by the Silberberg, Brakenhoff, and Wilson groups [25, 26]. Unlike SHG, which arises from asymmetries on the size scale of , THG contrast arises from the 3D volume around interfacial regions with a change of refractive index [27]. Since all cells and tissues have such changes in refractive index, THG can be an effective general imaging tool to map structural distributions in cells and tissues. For example, the sensitivity of THG to cell membranes and other border regions has been successfully utilized to image unstained lipid bodies in cells and whole zebrafish embryos [27]. We note that although THG and SHG arise from very different contrast mechanisms the two modalities are complementary, enabling 3D visualization of different aspects of cells and the ECM (Table 1).


MethodPrimary informationSignal dependence on concentrationLasersContrast sourceEmission directionApplicabilityDetection wavelength

SHGStructural/assemblyQuadraticFs Ti:sapphFibrillar collagen, actomyosinF/B tissue dependentBulk tissuesNear UV-visible
THGStructural/assemblyQuadraticTi:sapph pump+OPO, Cr:forsterite, custom-built filtered supercontinuum, ytterbiumChange in refractive indexF/B tissue dependentInterfaces in cells, tissueNear UV
TPEFProtein sensing/function/localizationLinearFs Ti:sapphDye, intrinsic fluorophores4πCells, tissuesVisible
CARSChemicalQuadraticPs pump source (ti:sapp or Nd:YVO4)+OPOMostly C-H lipidsPrimarily forwardCells, tissuesVisible

3. SHG and THG Theory/Photophysics

Given that the contrast from SHG and THG directly arises from their respective physical origins, here we provide an overview of the underlying nonlinear optical theory of each. A material’s response to an applied electric field can be described using polarization according to the following relationship:

where is the th-order nonlinear susceptibility. The nonlinear effects are achieved at higher order susceptibility (). SHG and other relatively similar nonlinear processes (i.e., sum frequency generation (SFG) and difference frequency generation (DFG)) are governed by [15]. The third-order susceptibility, , gives rise to THG in addition to two-photon and three-photon absorption, CARS, and stimulated Raman scattering (SRS).

The susceptibility tensor, , is a bulk property and is the quantity measured in an experiment. However, the molecular level property of the nonlinearity, i.e., the first hyperpolarizability, , forms the basis of the contrast mechanism. This parameter is defined in terms of the permanent dipole moment:

The molecular and bulk properties are then related by where is the density of molecules and the brackets denote their orientational average. Thus, harmonophores must have a permanent dipole moment, where these must be aligned within the focal volume of the microscope so that is nonzero (Figure 2). These constraints limit the different proteins that can be visualized with SHG, where the main species are collagen and myosin. In comparison, other matrix proteins do not have either regular molecular structures or assemblies thereof. Additionally, sample orientation with respect to laser polarization gives rise to either zero, strong, or weak SHG signal, where linear polarization preferentially excites specific dipoles (Figure 2(c)) and circular polarization excites all dipoles equally.

While there has been interest in imaging skeletal muscle, the large majority of SHG microscopy has been performed on tissues comprised primarily or partially of type I collagen (or Col I), which is the most abundant protein in the body. It is thus important to elucidate the contrast mechanism in terms of the collagen molecular structure. For example, Schanne-Klein and coworkers used Hyper-Rayleigh Scattering (HRS) measurements to show that the hyperpolarizability, , arose from coherent amplification of peptide bonds along the length of the molecule [28]. This finding was consistent with our analysis using polarization-resolved measurements, which revealed that the nonvanishing matrix elements governing can be related to the pitch angle (~50 degrees) of the individual α-helices in the collagen molecule (see Section 5.3) [30].

THG is a third-order nonlinear process, which involves a real susceptibility and is related to the nonlinear refractive coefficient by where is the vacuum dielectric constant, is the linear refraction coefficient (), and denotes the real component of a complex value [31]. Thus, THG is sensitive to inhomogeneities such as aqueous medium interfaces and microstructures where is highly mismatched [25]. Despite the lower peak power, the THG intensity can be larger using a lower NA objective, as the signal arises from the volume around the region of refractive index difference, rather than the interfacial region itself. Consequently, this modality does not provide strong contrast for bulk volumes in tissue with similar refractive index, e.g., bands of collagen that still provide the same asymmetry needed for SHG.

4. Microscope Setup/Instrumentation

Here, we provide the salient equipment aspects that are specific to SHG and THG microscopes (Figure 1(b)), which are typically built around the same laser scanning platforms as other MPM systems. Traditionally, these systems have multiple detection channels, enabling simultaneous forward and backward collection. We have previously described the calibration process for SHG acquisition [32]. As THG is primarily forward emitted, as shown in Figure 1, we use a dichroic to separate out the SHG and THG signals. The most common excitation source used for SHG imaging is the Nd:YVO4 (532 nm pumped (titanium sapphire or ti:sapphire)) femtosecond oscillator, where these have tuning ranges of approximately 700-1000 nm. This spectral region is ideal for SHG imaging due to several considerations. Firstly, while scattering limits the penetration depth into tissue and decreases at longer wavelengths, the SHG conversion efficiency also decreases by about 3-fold over this range [33]. Moreover, this range enables simultaneous imaging of essentially all fluorophores via two-photon excitation [34]. We have previously shown that the SHG conversion efficiency increases at shorter wavelengths (at least measured to 780 nm), and while not exact, it followed the trend predicted by a two-state model [33]. However, collection of SHG at wavelengths less than 380 nm is limited by glass optics. THG on the other hand needs to be performed at wavelengths longer than about 1200 nm for optical transmission of the signal through glass optics. Laser sources for this purpose have included optical parametric oscillators, frequency-shifted fiber lasers, and Cr:forsterite [35, 36]. In practice, choosing the optimal wavelength for combined SHG and THG imaging experiments depends on available laser sources and emission filters that enable simultaneous excitation and detection.

Due to their ability to image structural features of tissues, polarization control is a critical aspect of both SHG and THG imaging. This is because these techniques are label-free and the contrast is subject to the constraints of the electric dipole interaction, where the best contrast is achieved when the molecular dipoles are parallel to the plane of laser polarization. This yields structural richness where specific information content and applicability will be discussed in latter sections. Here, we describe the general approaches to achieve precise polarization, either circular or linear, at the plane of focus in a SHG or THG microscope.

For SHG imaging, circular polarization is widely used as it simultaneously excites all orientations equally [32]. While circularly polarized light is readily attainable at the laser output with a quarter-wave plate, the resulting state at the plane of focus becomes elliptical due to non-45-degree reflections, birefringence, and strain in the dichroics and other optics in the path. We have shown how that can be corrected through the use of a half-wave plate before the quarter-wave plate that acts as a compensator [32]. Linear polarization can be similarly distorted and easily corrected through compensation by either a quarter- or half-wave plate or Babinet-Soleil compensator. We then use a liquid crystal modulator in the infinity space to either rotate the linear polarization or reverse the handedness of circular polarization for SHG-circular dichroism (SHG-CD) analysis [37]. Other polarization distortion correction approaches have been applied but are not as general as this combination of compensation and motion-free rotation in the infinity space [38]. Polarization-sensitive approaches to THG use similar instrumentation.

5. SHG Microscopy for Biomedical Applications

Over the last two decades, there has been an increasing interest in applying SHG and THG microscopies to image a wide range of tissues. In the next several sections, we will present emerging studies that have significantly contributed to the advancement of these tools for basic science and translational applications (Table 2).


MethodContrast sourceAdvantagesDisadvantagesKey information extracted

F/B ratioCollagen fibrils(i) Straightforward measurement with matched detectors(i) Accuracy dependent upon calibration ratio
(ii) Require tissues to be at least one scattering length thick
(i) Subresolution fibril organization/morphology (i.e., size and packing)
P-SHGCollagen fibrils/fibers(i) Motionless optics
(ii) Pixel-based
(iii) Differentiate between fibrillar collagen isoforms
(i) Difficult to translate to in vivo applications due to optical scattering
(ii) Precise calibration of polarization needed
(iii) Lengthy acquisition time
(i) Order of dipole moments and collagen helical pitch angle
SHG-CDAlignment of chiral collagen within fibrils(i) Quick measurement
(ii) Sensitive
(iii) Pixel-based
(i) Precise calibration of polarization needed(i) Net chirality

5.1. Collagen Fiber Alignment

While the large majority of cancers are epithelial in nature, essentially all these tumors involve significant remodeling of the ECM both during early-stage disease and throughout progression [30]. These alterations can be in the form of increased collagen synthesis (desmoplasia), changes in morphology/alignment, and changes in collagen isoform expression, e.g., increased Col III or Col V synthesis. Historically, these ECM modifications have received little attention from pathologists, who mainly focus on cellular attributes via hematoxylin and eosin (H&E) staining (i.e., nucleus to cytoplasmic ratio) and expression of disease specific markers for diagnostics. Moreover, the eosin labeling is not highly sensitive to fibrillar collagen morphology. However, SHG microscopy, with its sensitivity/specificity to visualize collagen, is well suited for this task, and here we provide some seminal examples demonstrating this unique power.

SHG microscopy has perhaps been particularly powerful in providing valuable insights into collagen remodeling in breast cancer [3942]. It is well known that increased collagen density in breast tissue increases the risk of carcinoma; however, it is not directly causal, and conventional tools such as ultrasound cannot resolve the fibrillar structure [43]. To this end, in pioneering work, Keely and coworkers quantified collagen alignment to classify stages of remodeling during disease progression. Using murine tumor models, they identified three distinct and robust patterns they dubbed tumor-associated collagen signatures (TACS) [43, 44], defined by TACS-1, dense collagen accumulation around small tumors; TACS-2, elongated collagen fibers parallel to the tumor boundary; and TACS-3, collagen fibers normal to the tumor boundary, where the latter facilitate invasion (as demonstrated in Figure 3) and likely metastasis as well. Translating this study to human tissues in a tumor microarray, they found that TACS-3 was associated with disease recurrence and poor patient survival [40].

Similarly, Boppart and coworkers characterized the tumor microenvironment of untreated human breast tissues. Here, they custom built a portable nonlinear imaging system, integrating four modalities including SHG, THG, TPEF, and three-photon excited fluorescence [45]. This intraoperative platform enabled visualization of collagen alignment, tumor cell infiltration, blood vessels, mammary ducts, and lipids, with resolution and detail similar to those of the gold standard, H&E-stained histology. In invasive ductal carcinoma, they found that in response to tumor cell infiltration, the collagen was aligned parallel to the tumor cells. During both early- and late-stage disease, desmoplasia-associated collagen fibers were thick and straightened in comparison to thin and wavy in the tumor itself, and there was a distinct boundary between the cellular tumor and the desmoplastic regions. Additionally, during later stage disease, tumor cells infiltrated the desmoplasia-associated collagen region and shed extracellular vesicles, suggesting there was intracellular communication involved in the remodeling.

Pancreatic ductal adenocarcinoma (PDAC) has the poorest 5-year survival rate of all epithelial cancers. These tumors are characterized by a significant increase in stromal collagen density, making them well suited for investigation by SHG microscopy to explore whether analogous alignment changes to those in breast cancer occur in PDAC [46]. Indeed, Eliceiri and coworkers found that increased collagen alignment correlated with poor patient prognosis, where PDAC patients with low and high collagen alignment had median survival rates of 26.9 and 18.5 months, respectively [47]. Additionally, they found that this collagen reorganization was associated with an epithelial-mesenchymal transition expressed by PDAC cells and further that cancer-associated fibroblast markers were activated in the tumor microenvironment. Quantifying collagen reorganization and its relationship with such cellular processes provides critical information in terms of understanding disease pathology.

There have been other studies that examine the role of collagen alignment via SHG in several other epithelial cancers, including those of the ovary [48], prostate [49], and lung [50]. For example, SHG images of normal ovary and malignant tumors showed a vast morphological difference in the collagen assembly, where collagen fibers in the normal tissue were cross-hatched and randomly oriented in contrast to highly frequent wavy and aligned fibers in ovarian cancer [51]. Similarly, SHG images from human prostate cancer showed that collagen fibers in metastatic tumors were preferentially aligned in comparison to those that were still localized as well as to normal tissue [52]. Another group showed that in vivo non-small-cell lung cancer (NSCLC) xenograft models that overexpressed a cross-linking enzyme (LOXL1) resulted in higher collagen alignment, suggesting that increased cross-linking is a key component in NSCLC tumorigenicity [53].

In addition to solely assessing collagen alignment, cellular responses to these ECM modifications have also been investigated. For instance, Grzybowski et al. investigated trajectories of metastatic cancer cells and their noninvasive counterparts [54]. Here, they investigated metastatic potential using scaffolds of micropatterned lines, on which cells performed one-dimensional motions, mimicking the motility of cells migrating in 3D, and further are observed in metastasizing tumor cells in vivo. Using SHG and TPEF, they found that both metastatic and nonmetastatic cell lines infiltrated the dermis by following linear structural interfaces provided by parallel microtracks, blood vessels, or collagen bundles. However, the cellular kinetics were markedly different where metastatic cells were superdiffusive in zones away from the tumor while nonmetastatic cells reverted to ordinary diffusive motions.

5.2. SHG Polarization Analysis

Imaging by SHG has additional richness beyond such visualization and analysis of the fibrillar morphology. The nonlinear susceptibility tensor, , matrix elements contain information on the molecular and supramolecular structure that can be extracted utilizing polarization dependence on the excitation, SHG signal, or both. For example, we showed that measurements of the SHG intensity as a function of linear laser polarization can be analyzed to yield the α-helical pitch of well-aligned systems such as tendon and skeletal muscle, where this is dubbed the single-axis molecular model (Figure 4) [5557]. In the general dipole expression, the SHG intensity can be defined as where represents the number density of the elemental dipoles and , , and are numerical coefficients related to the matrix elements of . If we assume both cylindrical and Kleinman’s symmetry, these coefficients can be reduced to: , , and , which are then related to the α-helical angle. Importantly, this analysis yields values in good agreement with structural biology studies. This model was improved upon by Dong and coworkers where they incorporated chiral and achiral components in their analysis and were able to differentiate Col I and Col II within the same tissue [56].

A limitation of this overall approach is the requirement of well-defined fiber alignment (e.g., found in tendon), where this condition is not met in most tissues. To address this problem, Brasselet et al. implemented a pixel-based generic model which analyzes the distribution of dipole moments within the focal volume [58]. We adapted this approach to reconstruct the linear polarization response described above and also determine the alignment of dipole moments within the focal volume (signal anisotropy), as demonstrated in Figure 4 [57]. For this purpose, 361 images were collected at each field of view, where 19 excitation and 19 emission angles were acquired every 10 degrees.

Further refinements and expansions of these ideas have focused on identifying specific collagen molecular attributes giving rise to the second-order nonlinear optical response. For example, using polarization in/polarization out (PIPO) and quantum calculations, Barzda et al. associated different parts of the collagen molecule with different tensor elements [59, 60]. This method allows for the extraction of the second-order susceptibility ratio, a measure of fibril distribution asymmetry, and fibril orientation (weighted average), both of which are important for the hierarchical organization of collagen. Furthermore, the triple helical tilt angle with respect to the fibril axis and overall fibril architecture within the 3D volume of each voxel can be deduced.

Additionally, the related SFG polarization-resolved microscopy can probe these aspects by using a combination of nonresonant NIR and resonant IR excitation. Using different approaches, SFG analysis has uniquely identified the chiral and achiral contributions from the collagen molecule. Specifically, using low-resolution microscopy, Knoesen et al. investigated the molecular origins of the second-order nonlinear response from collagen fibrils [61] and identified methylene groups associated with a Fermi resonance and carbonyl and peptide groups associated with the amide I band as the dominant contributors. Moreover, methylene groups are non-centrosymmetrically aligned and denoted by a tilt in the pyrrolidine rings of proline and hydroxyproline residues with respect to the fiber axis, resulting in a strong achiral contribution. In contrast, they found a strong chiral contribution from the helical disposition of carbonyl groups around the main collagen molecule axis in collagen I fibrils. Potma et al. investigated the source of the SFG contrast by tuning through known vibrational resonances [62]. Specifically, polarization analysis of the methylene groups revealed that the dominant SFG signal originates from the achiral and tensor elements, where these are preferentially enhanced over nonresonant components.

Lastly, SHG has been combined with circular dichroism (SHG-CD) implementation for a nonlinear analog of the standard spectroscopic tool used to study protein folding. This approach has sensitivity for studying chirality of protein assemblies; however, SHG-CD is a coherent process and does not require absorption like conventional CD. In brief, images are collected using left- and right-handed (LH and RH) circularly polarized (CP) laser excitation and intensities of the two images are measured and denoted by where and refer to SHG pixel intensities from RHCP and LHCP images, respectively. This normalized difference can be related to collagen attributes such as the triple helix chirality and the out-of-plane tilt angle [63].

Collectively, these polarization schemes, sometimes generally denoted P-SHG, have received considerable attention over the last several years [59, 64, 65]. Here, we highlight a subset of applications using P-SHG.

5.2.1. Cancer Applications

We have used the generic pixel-based model [58] described above to probe the supramolecular structure of collagen in ovarian cancer [57]. This study was undertaken as previous studies based on immunostaining had suggested that the Col III isoform was upregulated in high-grade disease relative to normal stroma [20]. As the respective α-pitch angles of the Col I and III isoforms are different by about 2 degrees, in principle, these can be delineated by the single-axis molecular model. We validated this approach using a series of self-assembled collagen gels, ranging from 0 to 40% Col III, with the balance comprised of Col I and delineated structural differences via P-SHG, where the latter had a higher pitch angle, consistent with structural biology analysis [57]. However, the pitch angle in human tumors was lower than normal and inconsistent with a Col III increase [65]. We found lower anisotropy (i.e., dipole alignment within fibrils) and lower SHG-CD in high-grade disease relative to normal tissues, where this is consistent with either rapidly degraded or incorrectly synthesized collagen.

Barzda and researchers used PIPO to quantify structural changes of collagen in breast and lung cancers [50, 66]. Examining three pathologic types of invasive breast cancers, they found that tumors overexpressing estrogen, progesterone, and human epidermal growth factor receptors all resulted in significant changes within the collagen triple helix and/or fibril organization [66]. In their most recent study investigating different stages of non-small-cell lung carcinoma, they showed that during tumor progression, the submicron collagen architecture is more disorganized and fragmented [50]. Additionally, the remodeled collagen fibers were straighter and more aligned.

5.2.2. Fibrosis

Similar to ovarian cancer, it has been suggested by immunostaining that Col III is upregulated in idiopathic pulmonary fibrosis (IPF) [67, 68]. Likewise, our pixel-based SHG analyses also revealed no observable differences in the α-helical pitch angle between normal and IPF human tissues [69]. However, SHG-CD analysis showed that the chirality of the triple helix was significantly decreased (almost twofold) in the diseased state. Further response, the SHG-CD also showed a more random distribution of fiber polarity, where taken together these observations are consistent with incorrectly assembled collagen in IPF (Figure 5). The question as to why P-SHG did not show differences in the α-helical pitch angle in both IPF and ovarian cancer remains unanswered. However, we note the literature suggestions were based solely on immunostaining, where the available antibodies are not specific to Col III.

Similarly, Huang and researchers utilized P-SHG to analyze changes in collagen isoform balance and fibril orientation during progressive fibrosis in bile-duct-ligation (BDL) rat liver models [70]. BDL samples harvested between 0 and 6 weeks showed an increase in collagen deposition with more randomly oriented fibers. Furthermore, these studies revealed that the Col III/Col I ratio significantly increases during disease progression, suggesting that collagen type III is an important contributor in the severity of liver fibrosis.

5.2.3. Cornea

Schanne-Klein’s group demonstrated the novel capability of P-SHG and advanced data processing to visualize and accurately orient submicron spatial features of the structural organization in human corneal stroma via backward-detected SHG [71]. While not precisely providing structural information about corneal stroma, the resulting backward-collected P-SHG intensity was most significant when collagen fibrils were aligned with the incident excitation field. As a first step toward in vivo imaging, they imaged ex vivo whole porcine eyeballs and retrieved information from different lamellar domains through the entire 800 μm cornea thickness. Although forward directed signals could not be detected with this configuration, their results showed that lamellar domains were smaller in the anterior vs. posterior stroma, consistent with physiological data. Additionally, they successfully performed in vivo imaging of rat cornea using epi-detected P-SHG and were able to determine orientation and , which is reflective of the anisotropy of nonlinear responses from lamellar domains of collagen fibrils, throughout the entire thickness (~150 μm). These studies on cornea present evidence revealing the power of P-SHG to probe the submicron stromal collagen features despite dynamic movements and its potential to be a useful diagnostic tool for diseases that undergo collagen remodeling.

In another study in ocular samples, Bueno et al. used Stokes-vector based polarimetry and SHG-CD to assess internal organization and explore the relationship between diattenuation, which contains global information on polarization sensitivity, and external collagen organization [72]. Here, they collected four polarimetric SHG images corresponding to left circular and linear horizontal and two elliptical incident polarization states from 14 different ocular samples. Their results revealed that increased external fiber distribution resulted in a higher diattenuation of the polarization response sensitivity. Furthermore, this suggested that this behavior is general and does not depend on the angle between the fiber axis and incident polarization. Moreover, in partially and quasi-aligned samples, they found a strong structural correlation between collagen fiber orientation and direction of maximum intensity, suggesting that selecting the appropriate incident polarization could increase SHG signal obtained from samples that would otherwise present with low contrast. Additionally, SHG-CD values and hyperpolarizability ratios () had a linearly dependent relationship, indicating that collagen chirality is highly associated with internal (i.e., molecular) collagen fibril organization.

5.2.4. P-SHG and Optical Clearing

While powerful in probing structural changes in tissues, P-SHG techniques have a fundamental limitation in imaging depth. For example, we showed that these responses become largely scrambled within 1-2 scattering lengths (~20-50 microns) in both tendon and skeletal muscle [73]. It was previously reported by Wang using Mueller matrix analysis that birefringence (found in collagenous tissues) results in asymmetric scattering and can cause a rapid depth-dependent loss of polarization [74]. Similarly, Schanne-Klein et al. performed an in-depth analysis specific to SHG considering effects including scattering, birefringence, and diattenuation and verified that birefringence played a major role in depolarization [75].

To help overcome the inherent depth limitations in turbid tissues while maintaining high resolution coupled with polarization analysis, SHG imaging can be combined with optical clearing [76]. Here, samples are placed in a high refractive index, hyperosmotic reagent (e.g., glycerol, sugars, or sugar alcohols) to increase its transparency. We have shown that this reduces the scattering coefficient by ~5- to 20-fold and P-SHG of tendon and muscle fully retained the correct polarization signatures [77]. Indeed, most of the studies reviewed above were either performed on thin sections (less than one scattering length) or were optically cleared with 50% glycerol.

5.2.5. THG Polarization Microscopy

Until recently, polarization-resolved THG (P-THG) was infrequently used for biological imaging. Many of these imaging experiments use linearly polarized laser light because the induced third harmonic polarization vanishes in isotropic media excited with circularly polarized light, even if heterogeneity exists [78]. However, strongly birefringent media can produce efficient THG with both circularly and linearly polarized light and provide new structural information. For example, using linearly and circularly polarized THG (P-THG), Bautista et al. were able to identify and discriminate between lipid droplets (LDs) with different lipid compositions. First, they imaged synthetic enriched LDs followed by a macrophage model and P-THG successfully discriminated between the different lipid compositions due to their intrinsic ordering [79]. Similarly, Beaurepaire et al. used P-THG to image multilamellar vesicles, validating its use to probe lipid orders [80]. Applying this technique to a more complex tissue environment, they imaged human skin biopsies and found that THG signal was localized near interfaces with dried, dead corneocytes which consisted of stacked lipid bilayers.

More detailed analysis of the polarization response can provide additional richness. Barzda et al. implemented P-THG by combining nonlinear Stokes-Mueller polarimetry with THG microscopy [81]. Investigating two common symmetry classes, an isotropic and cylindrical case, they successfully recovered all eight accessible tensor components directly from measured data, where these values were comparable to those obtained from different models. In a more recent study, Beaurepaire et al. developed a fast P-THG microscopy technique to quickly modulate excitation polarization combined with Fourier-based analysis [82]. Using this approach, they were able to probe molecular ordering in deforming multilamellar lipid structures, examine biomineralization of flowing particles in zebrafish, and also detect birefringence in vivo.

5.3. SHG and THG Physics-Based Approaches

Both SHG and THG are coherent processes, where there is a spatial and temporal relationship between the excitation and generated signal based on phase-matching considerations. This results in a distribution of forward and backward emitted components that depend on the tissue structure. While this presents additional experimental challenges relative to fluorescence, which is incoherent and equally emitted over 4π steradians, as we will describe below, there is a wealth of structural information in the spatial emission pattern in these harmonic modalities.

Expanding upon the framework of Mertz and Moreaux [83], we developed an empirical model to predict trends of the forward and backward emitted components and relative SHG intensities as a function of collagen fibril size and packing on the axial size scale with respect to [84]. This emission pattern arises from the phase mismatch (), which is defined by , where and are the wave vectors for the SHG and incident photons, respectively. For ideal phase matching, , which can be seen in uniaxial crystals and interfaces, SHG emission is 100% forward directed and copropagates with the laser with infinite coherence length. However, such conditions do not exist in biological tissues. This results in a distribution of forward and backward components due to the need to conserve momentum, where the SHG intensity is modulated by a sinc2 function of . A larger phase mismatch results in both a lower forward-backward ratio, which we denote the creation ratio or emission directionality, , and weaker SHG intensity. In this treatment, “domains” or large or packed fibril structures axially aligned on the order of result in predominantly forward SHG, whereas smaller and/or more random structures with larger values are associated with backward directed SHG (although ) [27].

While this emission directionality contains potentially valuable subresolution structural information, in general, it is not directly measurable in a tissue imaging experiment, as the forward and backward components become convolved with scattering. The SHG emission and scattering cannot be decoupled analytically in the quasi-ballistic regime (~few scattering lengths) and we must use Monte Carlo (MC) simulations based on the bulk optical properties (scattering coefficient (), scattering anisotropy (), and absorption coefficient ()) to isolate . This scheme can also be used to extract the relative SHG conversion efficiencies in tissues, which are related to the collagen density as well as the phase mismatch.

We have used this approach in the analysis of several tissues, including connective (tendon, muscle, cartilage, and skin), ovarian, and lung tissues [51, 69, 8587]. Our emphasis has been on delineating structural differences in normal and diseased states, and here, we will highlight our efforts on human ovarian cancer. In initial studies, we found that high-grade serous ovarian cancer (HGSOC) had a lower than normal stroma, which was in agreement with predictions of our phase-matching model based on the respective TEM data [51]. We further applied this analysis to visualize heterogeneity within the tissues, by examining the emission directionality in small “pixel patches” on the size scale of microns [63]. Interestingly, we found very similar values across the image for HGSOC, whereas these were widely distributed for low-grade serous ovarian cancer. We speculated that this could arise from genetic differences between the diseases. For example, HGSOC is largely characterized by p53 alterations where in contrast low-grade disease is comprised of several other mutations [88, 89].

Performing this analysis over a range of wavelengths provides additional richness, as this affords comparing the SHG responses to the distribution of fibril sizes. For example, a weak wavelength dependence of and conversion efficiency would indicate that the fibrils are much smaller than the excitation wavelength. We used this approach to compare HGSOC, low-grade disease, and benign tumors over the spectral range of 780-1200 nm [90]. We found a fairly flat response for HGSOC, where the other tumors were characterized by higher values at longer wavelengths. This indicates that these tissues are characterized by larger harmonophore assemblies where the phase mismatch is reduced at longer wavelengths.

We also determined the wavelength-dependent relative conversion efficiencies for these tissues. The efficiency is a compounded effect of and the phase mismatch, which can have different spectral dependencies. Based on the two-state model [91], the susceptibility will decrease at longer wavelengths, where in contrast the phase mismatch will depend on tissue structure. Here, we found that the HGSOC conversion efficiency decreased at longer excitations and in fact behaved like we reported previously for tendon [33]. Interestingly, both tissues are characterized by regularly sized, uniformly packed fibrils that are ~60 nm in diameter. In comparison, the other tumors displayed higher conversion efficiencies at longer wavelengths due to larger fibrils providing improved phase matching (and higher ). In sum, these analyses based on coherence provide subresolution assessments, especially in terms of identifying structural differences between different tissue states.

While closely related to SHG, the THG emission directionality patterns in biological media have received considerably less attention. In early work, Mertz and Moreaux showed that for the case of ideal phase matching, the emission was in the form of a solid cone [83]. As depicted in Figure 6, the THG phase-matching conditions are denoted by , where describes the Gouy phase shift experienced inside the sample and and represent the wave vectors for the THG and incident photons, respectively. Beaurepaire et al. showed that most biological objects do not typically produce significant backward directed THG because the backward directed phase mismatch is typically two orders of magnitude larger than that of the forward [92]. Thus, for efficient backward THG emission, the Fourier spectrum needs to be comprised of large values that correspond to structures smaller than 100 nm in the direction, or the sample layer thickness must equate to backward radiating dipoles constructively interacting. Translating these theories to biological tissue imaging, THG was undetectable in the epi-direction in thin rat lung tissues in comparison to thick ones, illustrating that most of the collected signals arose from scattering of forward emitted components rather than direct backward coherent emission.

5.4. Image Analysis and Machine Learning

Over the past decade, image processing and machine learning tools have significantly advanced and have been shown to not only delineate but extract morphological features from SHG images from different types of tissues. While these tools have not yet been widely adopted or used clinically, we will discuss how they have enhanced our understanding of tissues especially in different diseases and how they may eventually be used for this purpose.

Several classes of image processing techniques have recently been utilized to quantify and/or classify SHG and THG images based on the tissue morphology. While segmentation methods based on thresholding are the simplest to employ and have been used to score fibrosis in the kidney [93] and liver [94], these techniques are only sensitive to intensity and not tissue architecture. To improve upon this, the use of signal processing tools including fast Fourier transforms (FFT) and grey level co-occurrence matrix (GLCM) has been explored. These techniques have associated outputs including alignment and correlation coefficients (e.g., energy and entropy). For example, we combined FFT, GLCM, and CT-FIRE to classify collagen architecture in normal fallopian tubes, high-grade ovarian and serous tubal intraepithelial carcinomas [95]. While each approach revealed only subtle differences between the two groups, combining the respective metrics in a linear discriminate analysis resulted in higher classification accuracy.

Image analysis tools have been developed to determine changes automatically and robustly in collagen morphology seen in SHG images. Global image tools like 2D Fourier transforms do not provide region-specific information such as changes in alignment around tumor boundaries seen in breast cancer and PDAC. However, local transforms have greater potential in this regard. For example, Eliceiri et al. implemented the fast discrete curvelet transform (CT) to identify such regions of local alignment by determining the angle of collagen fibers with respect to a user-defined or computationally segmented boundary [96]. This software is freely available as the CurveAlign ImageJ plugin. They also developed the CT-FIRE program that utilizes both the curvelet transform and a fiber extraction (FIRE) algorithm [97] to extract descriptive collagen fiber metrics (i.e., width, length, straightness, and angle) on an individual fiber basis [98].

Analyzing collagen fiber orientation is another area of interest in tissue characterization, especially in terms of characterizing the 3D ECM architecture. A powerful tool for this purpose was developed by Georgakoudi et al. that rapidly and accurately identified intensity variations in all directions within voxels of adjustable volumes [99, 100]. To demonstrate its applicability, they characterized collagen fiber organization in simple models and then more complex articular cartilage and breast cancer tissues. Their results successfully differentiated the layers of collagen organization in the different regions of cartilage and showed a decrease in 3D directional variance in breast cancer tissues, where lower directional variance corresponds to highly aligned fibers. Examining pancreatic tissues, they uncovered the potential for a decrease in 3D directional variance to reveal peritoneal metastases.

While these local and transform approaches have been successful in analyzing tissue structure, they do not specifically utilize machine learning (ML) techniques. We employed a ML texture analysis method, known as textons, to distinguish different classes of ovarian cancers [101]. Using unsupervised learning via -means clustering, textons (or repeating features) are identified by convolving small pixel patches of images with a 3D filter set of different orientations and scales. In the supervised learning classification stage, differences between the texton distributions of test and training data are evaluated by Gaussian weighted nearest neighbor comparison, which then are used to generate ROC curves to calculate classification accuracy. Implementing this tool to evaluate SHG images of normal ovary, high-risk ovarian stroma, benign and endometrioid tumors, and low- and high-grade serous ovarian cancers, we successfully classified the different classes with ~83-91% accuracy. Importantly, the same analysis on 2D data sets resulted in significantly lower accuracies (~70%), stressing the importance of examining the 3D ECM architecture.

Given the rapid development of deep learning techniques, these are beginning to be applied to harmonic microscopy images. Unlike machine learning, which requires labeled input data to train algorithms, deep learning relies on multilevel hierarchical layers in neural networks to train itself with little to no supervision or intervention. Additionally, deep learning allows for transfer learning, in which neural networks are trained on one sort of data set and can be applied to a different data set. Using this idea, Yu and researchers applied an automated deep learning-based algorithm to score images of liver fibrosis [102]. Based on the pathological scoring of the different fibrotic stages, they generated classification models using different supervised techniques, namely, convolutional neural networks (CNN), artificial neural networks, multinomial logistic regression, support vector machines, and random forests. By extraction of morphological and textural features and classification, they showed that the pretrained CNN produced accuracies between 85 and 95%, comparable to those from the other techniques. This suggests that transfer learning approaches may be used for weakly correlated and even unrelated images to overcome the current deep learning limitation of needing large image libraries. This is important as most often microscopy, especially on human tissues, is performed in the “data poor” regime.

We have provided a brief overview of the different approaches being used for image analysis and machine learning classification of SHG data. Table 3 summarizes the advantages and disadvantages of these methods. Tools such as GLCM and FFT are readily applicable to even small data sets for comparing image features. Typically, larger data sets are needed for classification schemes such as textons and the CNN-based deep learning methods. However, these in general are more powerful as they do not rely on simple morphological features such as fiber size and alignment, but rather on the overall features in the images. We note that new libraries need to be generated for each new tissue type/class to be analyzed.


Analysis toolProsCons

2D FFT(i) Boundaries not required
(ii) Integrated in a variety of image analysis tools (i.e., FIJI and Matlab)
(i) Global approach
(ii) Difficult to detect small alterations in tissues with random fiber alignment
Curvelets(i) Extracts collagen fiber in relation to defined boundaries; extremely useful in breast cancer studies(i) Needs tumor/cell boundary for accuracy; may not be readily translated to other diseases
GLCM(i) Simple intensity-based approach
(ii) Widely available in multiple image analysis platforms (i.e., FIJI and Matlab)
(i) Highly variable and dependent on collagen coverage
(ii) Low sensitivity and specificity in most applications to date
Textons(i) Filters independent of fiber and image characteristics(i) Requires large image library
(ii) Does not identify discrete features
(iii) Computationally intensive: making it difficult to integrate
3D-voxel(i) Translatable to multiple imaging modalities
(ii) Rapid and highly accurate
(iii) Voxel-wise information
(i) Requires fiber-like features
(ii) May not be well suited for thick tissues
Deep learning(i) Less tedious and more efficient
(ii) Independent of specified image characteristics
(iii) Implementation of transfer learning enables use of small data sets
(i) Can require large image library
(ii) Complex training of neural networks

5.5. Other Biological Applications

SHG microscopy has uncovered a profound remodeling of collagen in the ECM in many cancers and diseases, but in order to truly understand disease biology, it is also important to explore how these collagen alterations impact cellular interactions. For this reason, several labs have used SHG beyond its visualization capabilities and have revealed some downstream effects of collagen alterations including tumor growth, therapeutic response, and new matrix synthesis.

5.5.1. Imaging Chemotherapy Activity

While SHG imaging has been widely used to study ECM alterations in cancer, only recently has the chemotherapeutic response of tumor-associated collagen been examined. Shirmanova et al. used SHG and metabolic imaging to monitor tumor response to chemotherapy (i.e., cisplatin, paclitaxel, or irinotecan) in vivo, in mice implanted with colon cancer cells [104]. In untreated control tumors, the collagen to cellular ratio significantly increased. Interestingly, different chemotherapeutic agents resulted in the specific tumor-associated collagen (TAC) multidirectional alignment. For example, cisplatin and paclitaxel resulted in an early increase in SHG signal (increased collagen content or desmoplasia) whereas this was not impacted by irinotecan treatment. Collectively, their results suggest that alterations in cellular metabolism and collagen architecture occur prior to cell morphological changes.

These results are similar to those found in the studies of Wu et al. where they used autofluorescence and SHG to study chemotherapeutic response in advanced human breast cancer [105]. Here, they assessed the optical redox ratio, SHG to fluorescence ratio, and collagen density and orientation and found changes in collagen shape and alignment. Specifically, in comparison to normal and postchemotherapy, the collagen fibers were much straighter in the remaining carcinoma tissues. Additionally, while collagen degenerates during tumor progression, it regenerates after chemotherapeutic application, resulting in a fibrotic response.

5.5.2. Imaging Tissue Engineering Scaffolds

Conventional techniques such as immunofluorescence are not often successful in capturing the dynamic ECM environment of tissue engineering (TE) constructs. However, SHG is well suited for examining collagen synthesis from live cells in scaffolds, especially in conjunction with fluorescent markers. Here, we provide a couple examples of these possibilities.

Given that congenital heart defects (CHD) remain the leading cause of death in infants and children, TE approaches have recently been explored since surgical procedures have been widely ineffective at recapitulating the native heart anatomy and function. However, these TE applications have not examined fetal ECM organization and how it effects cardiac regeneration. To this end, Georgakoudi and coworkers explored the impact that such tissue has on the expansion of cardiomyocytes in vitro [106]. Here, they engineered ECM-coated substrates and seeded them with fetal, neonatal, and adult cardiomyocytes. They assessed the abundant proteins in each treatment group and found that fibronectin was the most prevalent in fetal and neonatal hearts whereas collagen I was the most dominant in adults. SHG images of decellularized hearts revealed that fetal ECM was associated with small collagen fibers resulting in significantly lower SHG intensity, which may explain why fetal hearts required less potent treatment and much shorter digestion times than adult tissues (1 h vs. up to 48 h). Additionally, cardiomyocytes not only adhered and expanded better on fetal ECM but they were also positive for mitosis, suggesting that proliferation may be better promoted as well.

Enejder and coworkers simultaneously captured SHG and coherent anti-Stokes Raman scattering (CARS) images to visualize microporous bacterial cellulose scaffolds seeded with osteoprogenitor cells to investigate the correlation between cells and new collagen synthesis [107]. First, they compared SHG and histology images of scaffolds one and seven days after seeding, with both methods similarly showing a significant increase in collagen content in the longer term scaffolds. Further, their results showed that scaffold material was capable of initiating osteogenesis due to the rather immediate (first days of growth) production of collagen by osteoprogenitor cells. Additionally, they found collagen fiber networks inside compact dense cellular regions within cellulosed micropores, which are important for new bone formation.

Cellular dynamics (i.e., orientation, adhesion, and migration) are essential to fully attain physiologic function, making their regulation extremely important for TE and cell therapy studies [108]. Researchers have employed physical stimuli and have shown that, in response, cells cultured in 2D and 3D environments change shape and orientation. An alternative mode is electrical stimulus, which is simple, flexible, feasible in vivo and ex vivo, and similar to physiological electrical activities in normal biological processes like embryonic development and wound healing [108]. Although cell behavior in response to electrical stimulus is well characterized in 2D cultured cells, this effect in a 3D matrix remains largely unknown. To this end, Cho et al. coupled SHG imaging and autofluorescence to evaluate the impact of electric stimulation on collagen and cell orientation and alignment in 3D collagen scaffolds [108]. While they found that electrical stimulation in collagen gels embedded with fibroblasts resulted in preferential collagen and cell alignment normal to the direction of the applied force, rat mesenchymal stem cells (MSCs) only showed minimal changes in cell orientation. Moreover, prior to stimulation, collagen fiber bundles were denser and more tightly packed with embedded MSCs, suggesting that the tight network prevented changes in orientation. This study reveals the power of SHG imaging to monitor specific cell-induced dynamic interactions in a 3D environment, which is imperative for optimizing tissue engineering approaches.

5.5.3. Imaging Col II in Cartilage

While this review has been highly focused on Col I, the Col II isoform is the primary matrix component of cartilage, including that of the patella. It is also fibrillar and, while morphologically distinct from Col I in structure, produces easily imaged SHG contrast. Historically, the cartilage in the patella is grouped into three zones delineated primarily by H&E staining. By examining the physical/structural depth-dependent ECM modifications in articular cartilage, we identified unique SHG signatures at both the fiber and fibril assembly in these three histological zones [85]. Interestingly, through SHG forward/backward analysis, we found that the middle zone contained the most organized fibril assembly, which is in strong contrast to the histological analysis of transverse sections which showed a disorganized structure.

In another study, Légaré et al. used SHG forward/backward analysis and P-SHG to examine the collagen architecture in equine fetal and adult meniscus [109]. As shown in Figure 7, they found large differences in not only the collagen architecture but also fibril orientation as a result of aging. In comparison to adults, the fetal menisci displayed a lower ratio, consistent with a less organized fibrillar structure. Additionally, through P-SHG, they showed that adult menisci had thick homogeneous clusters of fibrils oriented in the same directions.

6. THG Microscopy Biological Applications

THG microscopy is well suited for investigating complex system biology and when combined with other nonlinear modalities like SHG and TPEF allows for the precise mapping of several biological components. Here, we highlight some important applications of this imaging modality.

6.1. Developmental Biology

Perhaps the largest application of THG has been imaging aspects of developmental biology. This is because cell membranes and other organized structures with a change in refractive index are abundant in developing embryos. For example, Beaurepaire et al. were able to modulate, visualize, and quantify the complex biomechanical movements in Drosophila embryos in vivo by combining controlled intravital laser ablation and multimodal nonlinear microscopy (TPEF and THG) [110]. Here, they found that multiphoton ablation created a local microdissection within developing embryos, without significantly disrupting the surrounding cytoskeleton behavior, and THG microscopy successfully captured the resulting structural architecture (Figure 8). In addition, velocimetric data revealed information on the tissue dynamics, yolk internal structures, and their overall continuity. These experiments can be performed with strong biological viability due to the use of longer wavelengths (>1200 nm).

In a later study, they examined real-time micrometer-sized lipid bodies in situ via THG, allowing them to quantify lipid metabolism, image and track single lipid bodies in embryos, and map their distribution in intact animal and plant tissues [111]. Imaging hepatocytes isolated from rat liver under normal and regenerating (24 h after partial hepatectomy) conditions, they found that THG successfully detected differences in size and aggregation of lipid bodies which was significantly different between the two treatment groups. In addition, THG, SHG, and TPEF images of murine lung tissue allowed for visualization of the interactions between lipid bodies, the ECM, and cellular redox state, which may provide insight into physiological processes responsible for organ development and enable further assessment of altered fat metabolism observed in diseases such as diabetes and atherosclerosis.

6.2. Skin Cancer and Aging

Combining THG and SHG microscopies, Sun and coworkers have performed numerous studies imaging skin in vivo. One area of interest has been imaging changes in morphology due to aging, where THG and SHG visualize epidermal cellular morphology and dermal collagen, respectively [112]. As shown in Figure 9(a), THG contrast specifically captured differentiated changes in nuclear size, cell size, and cell density at different depths including the stratum corneum, stratum granulosum, stratum spinosum, and stratum basale. They found that basal cells were oval-shaped and organized in a honeycomb fashion in young skin and over time they become irregularly shaped ultimately losing their overall organization (Figure 9(b)). In addition, basal keratinocyte morphology was found to be a good scoring criterion for skin aging as both cellular and nuclear sizes were larger in elderly subjects in comparison to younger ones.

They further demonstrated the combined applicability of THG and SHG for analysis of noninvasive virtual skin cancer biopsies [113]. Here, they were able to identify cellular cytoplasm of keratinocytes, melanocytes, red blood cells, and fibroblasts via THG and collagen and elastin fibers by SHG and autofluorescence, respectively. This multimodal approach revealed an aggregation of melanoma cells in the epidermis in melanoma and also nodules of tumor cells enclosed by collagen fibers in pigmented basal cell carcinoma (BCC). More recently, to better understand THG sources in the skin, they decoupled the overpowering effects of melanin from other components using vitiliginous skin [114]. Furthermore, they assessed therapeutic efficacy of ultraviolet B (UVB) therapy in treating vitiligo to restore pigmentation and saw an increase in THG intensity for 7 out of 15 patients after 24 weeks of UVB treatment. In fact, in some cases, the intensity was comparable to that from normal basal keratinocytes.

6.3. Brain Imaging

THG is also capable of imaging lipid structures in the brain; for example, Groot and coworkers simultaneously imaged neurons, white-matter structures, and blood vessels, all of which have changes in refractive index relative to neighboring regions (Figure 10) [115]. Additionally, they were able to guide micropipettes toward specific neurons inside live tissue, demonstrating its applicability to assist in microsurgeries. They further used THG and TPEF microscopy to quantitatively assess glioma infiltration in human brain samples [116], where this addressed a well-defined problem in distinguishing normal brain cells from tumors during glioma surgery. Specifically, they were able to assess differences in cellularity and cell morphology when comparing cells from the main tumor mass to those spreading into normal tissue, clearly showing substantial morphological differences in unique glioma types. Moreover, THG images agreed with PET, MRI, and H&E images demonstrating its potential to be used as a clinical auxiliary tool for detecting abnormal areas.

Sun and coworkers further used THG microscopy to explore the neuropathology of fresh, ex vivo normal brain tissues from mice and obtained signal from the axons and dendrites from the neocortex, axon fiber bundles from the corpus callosum, and the hippocampus and axonal fiber bundles in the striatum [117]. Importantly, they clearly identified amyloid-β plaques (a neuropathological hallmark of Alzheimer’s disease) by performing a correlation with immunohistochemical staining.

7. SHG Microendoscopy

As discussed thus far, SHG and THG are powerful tools to examine and probe ECM and cellular organization in the tissue microenvironment in a number of disorders. These studies have largely been performed ex vivo, where in vivo applications have been limited to transparent specimens (e.g., embryos) or at superficial imaging depths (e.g., skin). However, emerging endomicroscopy technology is showing great promise for translating these nonlinear imaging applications from the laboratory benchtop to clinical bedside. Here, we highlight two seminal examples using proximal and distal scanning methods relative to the fiber optic.

In a major advance, Schnitzer et al. developed a wearable SHG microendoscope coupled to a laser and scanning electronics via fiber optics [118]. Here, the light is delivered into the muscle via an insertable needle containing a GRIN lens and a stimulating electrode (Figures 11(a) and 11(b)). Using this miniaturized approach, they observed sarcomere lengths and contractile dynamics in human subjects, allowing them to monitor individual motor unit contractions after electrical twitch stimulation. Specifically, they were able to measure and compare sarcomere lengths across six different muscles with ~30 nm precision. For example, they found that unitary contractions in the soleus had slower twitch times than the vastus lateralis, in good agreement with physiology analysis. Additionally, their device captured involuntary contractions and fasciculations and showed significant differences in sarcomere lengths comparing the spastic and contralateral arms in poststroke patients (Figures 11(c) and 11(d)).

Li and researchers have developed a distal scanning approach suitable for imaging cavities, where the light is scanned at the exit of the fiber optic. They demonstrated that their SHG/TPEF microendoscope is capable of real-time in vivo histological and functional imaging of fresh biological samples [119]. As shown in Figure 12, they found large changes in collagen fiber architecture in the cervix of preterm birth and normal pregnant mouse models, where the latter had a more porous network, consistent with prior benchtop studies [21]. Additionally, they assessed metabolic changes in a mouse kidney ischemia-reperfusion model in vivo, which were reversible upon reperfusion.

The key to their more recent successes was the utilization of double clad fibers, corrections of spherical aberrations, and the development of a grating-based dual-fiber for spectrotemporal dispersion compensation [121]. Collectively, these efforts improved the signal collection efficiency by a couple orders of magnitude.

8. Perspective and Outlook

Considerable improvements over the last decade in technology and analysis tools have been instrumental in establishing SHG and THG (as individual modalities and also in conjunction with each other and other techniques) as practical optical imaging tools for studying the tissue microenvironment. Nevertheless, many of the techniques discussed here have unique requirements in terms of equipment. For instance, polarization-resolved and SHG/THG physics approaches heavily rely on complex instrumentation and advanced optics to acquire images. Prior to incorporation into nonspecialty microscopy labs and the clinic, many of the concerns related to adding polarization optics and miniaturizing the bulky microscopes and lasers currently used must be addressed. However, small footprint fixed wavelength lasers with sufficient power are already commercially available and more have been recently reported. For example, using a fiber laser-induced super continuum source, Boppart and colleagues have developed a slide-free, compact, and reliable virtual histochemistry tool based on multiphoton microscopy. This technology can simultaneously collect up to four histochemical contrasts, including SHG, THG, TPEF, and three-photon excited fluorescence, in real time [122]. In addition to their enhanced efficiency and miniaturization, fiber optic techniques have advanced, permitting polarization control and analysis.

In contrast, image processing methods can already be easily integrated into both biology labs and clinical settings as they only need a computer with a graphics processing unit for rapid computation. Importantly, recent advances in machine learning have been demonstrated previously in ex vivo studies and could be readily implemented in the clinic (where texture analyses are already used for histology), especially when combined with a SHG/THG slide reader with a small footprint laser. This would enable basic researchers and hospitals to build diverse image libraries containing images, from specimens/patients of different sexes, ages, and ethnicities with different genetic information. Additionally, collecting multimodal images in conjunction with deep learning methods would further increase accuracies by offering unique yet complimentary metrics to potentially aid physicians in early diagnosis and monitoring disease progression.

While there have been significant advances in microendoscope technology, several limitations still remain, with the most significant being the achievable depth of penetration. This ultimately limits these devices to rely exclusively on backward detected SHG, which is always lower in intensity than the dominant forward channel. Still, current setups may prove successful in tissue imaging in vivo by backward SHG, where for example, this could be done with reversible optical clearing agents, where this has already been demonstrated [123]. Moreover, the backward channel can provide structural information on small, random structures not present in the forward direction. Indeed, we showed this effect in comparing collagen architecture in normal and decorin knockout murine prostate, where the latter results in smaller, disorganized fibrils [49]. While microendoscopes intrinsically have smaller fields of view and numerical aperture in comparison to benchtop setups, their resolution and collection efficiencies have increased tremendously [121]. Thus, they hold great promise for the future.

Lastly, we note that although conventional SHG microscopy collects image stacks through sequential en face optical axial sections, this is not a truly 3-dimensional modality. This is because SHG contrast is electric dipole forbidden when fibers are aligned in the direction of laser propagation, and analogously, fibers with high tilt angles have lower SHG intensities. As a result, valuable structural information can be missed. To solve this problem, we have begun to implement SHG microscopy as a tomographic modality to achieve complete 3D imaging [124]. Here, we perform conventional galvo scanning and then cylindrically rotate a specimen, thereby collecting images from multiple excitation angles. We showed by morphological and spatial frequency analysis of images from mouse tail tendon that this approach recovers the 3D structural information. The key to further establishing this approach is optimization of the registration/reconstruction algorithms. We anticipate this becoming a widely used approach for SHG imaging of thick tissues.

Given the increased practicality of SHG and THG microscopies, these modalities have significantly contributed a wealth of knowledge pertaining to the tissue microenvironment, enabling the examination and characterization of cells and ECM components in a wide range of normal and diseased states. Many of the methods could be readily applied to those with access to commercial multiphoton microscopes, in both research labs and clinical settings.

Conflicts of Interest

The authors declare no conflicts of interest.

Acknowledgments

PJC gratefully acknowledges support under NIH 1R01CA206561-01, R01CA232517-01, and 1R21CA224280-01A1. PJC gratefully acknowledges NSF CBET–1830964, and DSJ gratefully acknowledges support under NSF DGE-1747503.

References

  1. W. Denk, J. H. Strickler, and W. W. Webb, “Two-photon laser scanning fluorescence microscopy,” Science, vol. 248, no. 4951, pp. 73–76, 1990. View at: Publisher Site | Google Scholar
  2. P. J. Campagnola and C. Y. Dong, “Second harmonic generation microscopy: principles and applications to disease diagnosis,” Lasers and Photonics Reviews, vol. 5, no. 1, pp. 13–26, 2011. View at: Publisher Site | Google Scholar
  3. B. Weigelin, G. J. Bakker, and P. Friedl, “Third harmonic generation microscopy of cells and tissue organization,” Journal of Cell Science, vol. 129, no. 2, pp. 245–255, 2016. View at: Publisher Site | Google Scholar
  4. J. X. Cheng and X. S. Xie, “Coherent anti-Stokes Raman scattering microscopy: instrumentation, theory, and applications,” The Journal of Physical Chemistry. B, vol. 108, no. 3, pp. 827–840, 2004. View at: Publisher Site | Google Scholar
  5. P. J. Campagnola, A. C. Millard, M. Terasaki, P. E. Hoppe, C. J. Malone, and W. A. Mohler, “Three-dimensional high-resolution second-harmonic generation imaging of endogenous structural proteins in biological tissues,” Biophysical Journal, vol. 82, no. 1, pp. 493–508, 2002. View at: Publisher Site | Google Scholar
  6. M. Göppert-Mayer, “Über elementarakte mit zwei quantensprungen,” Annalen der Physik, vol. 9, pp. 273–294, 1931. View at: Publisher Site | Google Scholar
  7. P. A. Franken, A. E. Hill, C. W. Peters, and G. Weinreich, “Generation of optical harmonics,” Physical Review Letters, vol. 7, no. 4, pp. 118-119, 1961. View at: Publisher Site | Google Scholar
  8. P. J. Campagnola, M. D. Wei, A. Lewis, and L. M. Loew, “High-resolution nonlinear optical imaging of live cells by second harmonic generation,” Biophysical Journal, vol. 77, no. 6, pp. 3341–3349, 1999. View at: Publisher Site | Google Scholar
  9. L. Moreaux, O. Sandre, and J. Mertz, “Membrane imaging by second-harmonic generation microscopy,” Journal of the Optical Society of America B: Optical Physics, vol. 17, no. 10, pp. 1685–1694, 2000. View at: Publisher Site | Google Scholar
  10. S. Fine and W. P. Hansen, “Optical second harmonic generation in biological systems,” Applied Optics, vol. 10, no. 10, pp. 2350–2353, 1971. View at: Publisher Site | Google Scholar
  11. I. Freund and M. Deutsch, “Second-harmonic microscopy of biological tissue,” Optics Letters, vol. 11, no. 2, p. 94, 1986. View at: Publisher Site | Google Scholar
  12. O. Bouevitch, A. Lewis, I. Pinevsky, J. P. Wuskel, and L. M. Loew, “Probing membrane potential with non-linear optics,” Biophysical Journal, vol. 65, no. 2, pp. 672–679, 1993. View at: Publisher Site | Google Scholar
  13. L. Sacconi, D. A. Dombeck, and W. W. Webb, “Overcoming photodamage in second-harmonic generation microscopy: real-time optical recording of neuronal action potentials,” Proceedings of the National Academy of Sciences of the United States of America, vol. 103, no. 9, pp. 3124–3129, 2006. View at: Publisher Site | Google Scholar
  14. J. Adur, H. F. Carvalho, C. L. Cesar, and V. H. Casco, “Nonlinear microscopy techniques: principles and biomedical applications,” in In Microscopy and Analysis, IntechOpen, 2016. View at: Publisher Site | Google Scholar
  15. F. S. Pavone and P. J. Campagnola, Second Harmonic Generation Imaging, CRC Press Taylor & Francis, Boca Raton, 2014.
  16. P. Bianchini and A. Diaspro, “Three-dimensional (3D) backward and forward second harmonic generation (SHG) microscopy of biological tissues,” Journal of Biophotonics, vol. 1, no. 6, pp. 443–450, 2008. View at: Publisher Site | Google Scholar
  17. R. M. Williams, W. R. Zipfel, and W. W. Webb, “Interpreting second-harmonic generation images of collagen I fibrils,” Biophysical Journal, vol. 88, no. 2, pp. 1377–1386, 2005. View at: Publisher Site | Google Scholar
  18. S.-P. Tai, T.-H. Tsai, W.-J. Lee et al., “Optical biopsy of fixed human skin with backward-collected optical harmonics signals,” Optics Express, vol. 13, no. 20, pp. 8231–8242, 2005. View at: Publisher Site | Google Scholar
  19. A. T. Yeh, N. Nassif, A. Zoumi, and B. J. Tromberg, “Selective corneal imaging using combined second-harmonic generation and two-photon excited fluorescence,” Optics Letters, vol. 27, no. 23, pp. 2082–2084, 2002. View at: Publisher Site | Google Scholar
  20. C. Ricciardelli and R. J. Rodgers, “Extracellular matrix of ovarian tumors,” Seminars in Reproductive Medicine, vol. 24, no. 4, pp. 270–282, 2006. View at: Publisher Site | Google Scholar
  21. L. A. Meredith, L.-P. Katherine, and M. Mala, “Second harmonic generation imaging as a potential tool for staging pregnancy and predicting preterm birth,” Journal of Biomedical Optics, vol. 15, article 026020, 2010. View at: Publisher Site | Google Scholar
  22. K. Tilbury, J. Hocker, B. L. Wen, S. Sandbo, V. Singh, and P. J. Campagnola, “Second harmonic generation microscopy analysis of extracellular matrix changes in human idiopathic pulmonary fibrosis,” Journal of Biomedical Optics, vol. 19, no. 8, article 086014, 2014. View at: Publisher Site | Google Scholar
  23. W. Sun, S. Chang, D. C. Tai et al., “Nonlinear optical microscopy: use of second harmonic generation and two-photon microscopy for automated quantitative liver fibrosis studies,” Journal of Biomedical Optics, vol. 13, no. 6, article 064010, 2008. View at: Publisher Site | Google Scholar
  24. A. M. Pena, A. Fabre, D. Debarre et al., “Three-dimensional investigation and scoring of extracellular matrix remodeling during lung fibrosis using multiphoton microscopy,” Microscopy Research and Technique, vol. 70, no. 2, pp. 162–170, 2007. View at: Publisher Site | Google Scholar
  25. Y. Barad, H. Eisenberg, M. Horowitz, and Y. Silberberg, “Nonlinear scanning laser microscopy by third harmonic generation,” Applied Physics Letters, vol. 70, no. 8, pp. 922–924, 1997. View at: Publisher Site | Google Scholar
  26. J. Squier, M. Muller, G. Brakenhoff, and K. R. Wilson, “Third harmonic generation microscopy,” Optics Express, vol. 3, no. 9, pp. 315–324, 1998. View at: Publisher Site | Google Scholar
  27. J. A. Armstrong, N. Bloembergen, J. Ducuing, and P. S. Pershan, “Interactions between light waves in a nonlinear dielectric,” Physical Review, vol. 127, no. 6, pp. 1918–1939, 1962. View at: Publisher Site | Google Scholar
  28. F. A. M. D. Javier, B. P. Vitor, A. d. T. André et al., “Quantitative changes in human epithelial cancers and osteogenesis imperfecta disease detected using nonlinear multicontrast microscopy,” Journal of Biomedical Optics, vol. 17, pp. 1–10, 2012. View at: Publisher Site | Google Scholar
  29. L. Mostaço-Guidolin, N. L. Rosin, and T. L. Hackett, “Imaging collagen in scar tissue: developments in second harmonic generation microscopy for biomedical applications,” International Journal of Molecular Sciences, vol. 18, no. 8, article 1772, 2017. View at: Publisher Site | Google Scholar
  30. T. R. Cox and J. T. Erler, “Remodeling and homeostasis of the extracellular matrix: implications for fibrotic diseases and cancer,” Disease Models & Mechanisms, vol. 4, no. 2, pp. 165–178, 2011. View at: Publisher Site | Google Scholar
  31. M. Bass, G. Li, and E. V. Stryland, Handbook of Optics, Volume IV - Optical Properties of Materials, Nonlinear Optics, Quantum Optics, Multidisciplinary Digital Publishing Institute (MDPI), 3rd edition, 2010.
  32. X. Chen, O. Nadiarynkh, S. Plotnikov, and P. J. Campagnola, “Second harmonic generation microscopy for quantitative analysis of collagen fibrillar structure,” Nature Protocols, vol. 7, no. 4, pp. 654–669, 2012. View at: Publisher Site | Google Scholar
  33. G. Hall, K. B. Tilbury, K. R. Campbell, K. W. Eliceiri, and P. J. Campagnola, “Experimental and simulation study of the wavelength dependent second harmonic generation of collagen in scattering tissues,” Optics Letters, vol. 39, no. 7, pp. 1897–1900, 2014. View at: Publisher Site | Google Scholar
  34. C. Xu, R. M. Williams, W. R. Zipfel, and W. W. Webb, “Multiphoton excitation cross-sections of molecular fluorophores,” Bioimaging, vol. 4, no. 3, pp. 198–207, 1996. View at: Publisher Site | Google Scholar
  35. N. G. Horton, K. Wang, D. Kobat et al., “In vivo three-photon microscopy of subcortical structures within an intact mouse brain,” Nature Photonics, vol. 7, pp. 205–209, 2013. View at: Publisher Site | Google Scholar
  36. S.-W. Chu, I.-H. Chen, T.-M. Liu, P. C. Chen, C.-K. Sun, and B.-L. Lin, “Multimodal nonlinear spectral microscopy based on a femtosecond Cr:for sterite laser,” Optics Letters, vol. 26, pp. 1909–1911, 2001. View at: Publisher Site | Google Scholar
  37. C. H. Lien, K. Tilbury, S. J. Chen, and P. J. Campagnola, “Precise, motion-free polarization control in second harmonic generation microscopy using a liquid crystal modulator in the infinity space,” Biomedical Optics Express, vol. 4, no. 10, pp. 1991–2002, 2013. View at: Publisher Site | Google Scholar
  38. C. K. Chou, W. L. Chen, P. T. Fwu, S. J. Lin, H. S. Lee, and C. Y. Dong, “Polarization ellipticity compensation in polarization second-harmonic generation microscopy without specimen rotation,” Journal of Biomedical Optics, vol. 13, no. 1, article 014005, 2008. View at: Publisher Site | Google Scholar
  39. J. S. Bredfeldt, Y. Liu, M. W. Conklin, P. J. Keely, T. R. Mackie, and K. W. Eliceiri, “Automated quantification of aligned collagen for human breast carcinoma prognosis,” Journal of Pathology Informatics, vol. 5, p. 28, 2014. View at: Publisher Site | Google Scholar
  40. M. W. Conklin, J. C. Eickhoff, K. M. Riching et al., “Aligned collagen is a prognostic signature for survival in human breast carcinoma,” The American Journal of Pathology, vol. 178, no. 3, pp. 1221–1232, 2011. View at: Publisher Site | Google Scholar
  41. P. P. Provenzano, D. R. Inman, K. W. Eliceiri, and P. J. Keely, “Matrix density-induced mechanoregulation of breast cell phenotype, signaling and gene expression through a FAK-ERK linkage,” Oncogene, vol. 28, no. 49, pp. 4326–4343, 2009. View at: Publisher Site | Google Scholar
  42. C. T. Rueden, M. W. Conklin, P. P. Provenzano, P. J. Keely, and K. W. Eliceiri, “Nonlinear optical microscopy and computational analysis of intrinsic signatures in breast cancer,” in 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 4077–4080, Minneapolis, MN, USA, 2009. View at: Publisher Site | Google Scholar
  43. P. P. Provenzano, K. W. Eliceiri, J. M. Campbell, D. R. Inman, J. G. White, and P. J. Keely, “Collagen reorganization at the tumor-stromal interface facilitates local invasion,” BMC Medicine, vol. 4, no. 1, p. 38, 2006. View at: Publisher Site | Google Scholar
  44. P. P. Provenzano, D. R. Inman, K. W. Eliceiri et al., “Collagen density promotes mammary tumor initiation and progression,” BMC Medicine, vol. 6, no. 1, p. 11, 2008. View at: Publisher Site | Google Scholar
  45. Y. Sun, S. You, H. Tu et al., “Intraoperative visualization of the tumor microenvironment and quantification of extracellular vesicles by label-free nonlinear imaging,” Science Advances, vol. 4, article eaau5603, 2018. View at: Publisher Site | Google Scholar
  46. C. R. Drifka, J. Tod, A. G. Loeffler et al., “Periductal stromal collagen topology of pancreatic ductal adenocarcinoma differs from that of normal and chronic pancreatitis,” Modern Pathology, vol. 28, no. 11, pp. 1470–1480, 2015. View at: Publisher Site | Google Scholar
  47. C. R. Drifka, A. G. Loeffler, K. Mathewson et al., “Highly aligned stromal collagen is a negative prognostic factor following pancreatic ductal adenocarcinoma resection,” Oncotarget, vol. 7, no. 46, pp. 76197–76213, 2016. View at: Publisher Site | Google Scholar
  48. B. L. Wen, M. A. Brewer, O. Nadiarnykh et al., “Texture analysis applied to second harmonic generation image data for ovarian cancer classification,” Journal of Biomedical Optics, vol. 19, no. 9, article 096007, 2014. View at: Publisher Site | Google Scholar
  49. K. R. Campbell, R. Chaudhary, M. Montano, R. V. Iozzo, W. A. Bushman, and P. J. Campagnola, “Second-harmonic generation microscopy analysis reveals proteoglycan decorin is necessary for proper collagen organization in prostate,” Journal of Biomedical Optics, vol. 24, no. 6, pp. 1–8, 2019. View at: Publisher Site | Google Scholar
  50. A. Golaraei, L. B. Mostaço-Guidolin, V. Raja et al., “Polarimetric second-harmonic generation microscopy of the hierarchical structure of collagen in stage I-III non-small cell lung carcinoma,” Biomedical Optics Express, vol. 11, no. 4, pp. 1851–1863, 2020. View at: Publisher Site | Google Scholar
  51. O. Nadiarnykh, R. B. LaComb, M. A. Brewer, and P. J. Campagnola, “Alterations of the extracellular matrix in ovarian cancer studied by second harmonic generation imaging microscopy,” BMC Cancer, vol. 10, no. 1, p. 94, 2010. View at: Publisher Site | Google Scholar
  52. M. F. Penet, S. Kakkad, A. P. Pathak et al., “Structure and function of a prostate cancer dissemination-permissive extracellular matrix,” Clinical Cancer Research, vol. 23, no. 9, pp. 2245–2254, 2017. View at: Publisher Site | Google Scholar
  53. C. Zeltz, E. Pasko, T. R. Cox, R. Navab, and M. S. Tsao, “LOXL1 is regulated by integrin α11 and promotes non-small cell lung cancer tumorigenicity,” Cancers, vol. 11, p. 705, 2019. View at: Publisher Site | Google Scholar
  54. S. Huda, B. Weigelin, K. Wolf et al., “Lévy-like movement patterns of metastatic cancer cells revealed in microfabricated systems and implicated in vivo,” Nature Communications, vol. 9, no. 1, p. 4539, 2018. View at: Publisher Site | Google Scholar
  55. S. V. Plotnikov, A. C. Millard, P. J. Campagnola, and W. A. Mohler, “Characterization of the myosin-based source for second-harmonic generation from muscle sarcomeres,” Biophysical Journal, vol. 90, no. 2, pp. 693–703, 2006. View at: Publisher Site | Google Scholar
  56. P. J. Su, W. L. Chen, Y. F. Chen, and C. Y. Dong, “Determination of collagen nanostructure from second-order susceptibility tensor analysis,” Biophysical Journal, vol. 100, no. 8, pp. 2053–2062, 2011. View at: Publisher Site | Google Scholar
  57. K. Tilbury, C. H. Lien, S. J. Chen, and P. J. Campagnola, “Differentiation of Col I and Col III isoforms in stromal models of ovarian cancer by analysis of second harmonic generation polarization and emission directionality,” Biophysical Journal, vol. 106, no. 2, pp. 354–365, 2014. View at: Publisher Site | Google Scholar
  58. J. Duboisset, D. Ait-Belkacem, M. Roche, H. Rigneault, and S. Brasselet, “Generic model of the molecular orientational distribution probed by polarization-resolved second-harmonic generation,” Physical Review A, vol. 85, no. 4, 2012. View at: Publisher Site | Google Scholar
  59. A. E. Tuer, S. Krouglov, N. Prent et al., “Nonlinear optical properties of type I collagen fibers studied by polarization dependent second harmonic generation microscopy,” The Journal of Physical Chemistry. B, vol. 115, no. 44, pp. 12759–12769, 2011. View at: Publisher Site | Google Scholar
  60. A. E. Tuer, M. K. Akens, S. Krouglov et al., “Hierarchical model of fibrillar collagen organization for interpreting the second-order susceptibility tensors in biological tissue,” Biophysical Journal, vol. 103, no. 10, pp. 2093–2105, 2012. View at: Publisher Site | Google Scholar
  61. I. Rocha-Mendoza, D. R. Yankelevich, M. Wang, K. M. Reiser, C. W. Frank, and A. Knoesen, “Sum frequency vibrational spectroscopy: the molecular origins of the optical second-order nonlinearity of collagen,” Biophysical Journal, vol. 93, no. 12, pp. 4433–4444, 2007. View at: Publisher Site | Google Scholar
  62. Y. Han, J. Hsu, N. H. Ge, and E. O. Potma, “Polarization-sensitive sum-frequency generation microscopy of collagen fibers,” The Journal of Physical Chemistry. B, vol. 119, no. 8, pp. 3356–3365, 2015. View at: Publisher Site | Google Scholar
  63. K. R. Campbell and P. J. Campagnola, “Assessing local stromal alterations in human ovarian cancer subtypes via second harmonic generation microscopy and analysis,” Journal of Biomedical Optics, vol. 22, no. 11, pp. 1–7, 2017. View at: Publisher Site | Google Scholar
  64. S. Brasselet, “Polarization-resolved nonlinear microscopy: application to structural molecular and biological imaging,” Advances in Optics and Photonics, vol. 3, no. 3, pp. 205–271, 2011. View at: Publisher Site | Google Scholar
  65. K. R. Campbell, R. Chaudhary, J. M. Handel, M. S. Patankar, and P. J. Campagnola, “Polarization-resolved second harmonic generation imaging of human ovarian cancer,” Journal of Biomedical Optics, vol. 23, no. 6, pp. 1–8, 2018. View at: Publisher Site | Google Scholar
  66. A. Golaraei, L. Kontenis, R. Cisek et al., “Changes of collagen ultrastructure in breast cancer tissue determined by second-harmonic generation double Stokes-Mueller polarimetric microscopy,” Biomedical Optics Express, vol. 7, no. 10, pp. 4054–4068, 2016. View at: Publisher Site | Google Scholar
  67. J. D. Fulmer, R. S. Bienkowski, M. J. Cowan et al., “Collagen concentration and rates of synthesis in idiopathic pulmonary fibrosis,” The American Review of Respiratory Disease, vol. 122, no. 2, pp. 289–301, 1980. View at: Publisher Site | Google Scholar
  68. G. Raghu, L. J. Striker, L. D. Hudson, and G. E. Striker, “Extracellular matrix in normal and fibrotic human lungs,” The American Review of Respiratory Disease, vol. 131, pp. 281–289, 1985. View at: Google Scholar
  69. D. S. James, A. N. Jambor, H. Y. Chang et al., “Probing ECM remodeling in idiopathic pulmonary fibrosis via second harmonic generation microscopy analysis of macro/supramolecular collagen structure,” Journal of Biomedical Optics, vol. 25, pp. 1–13, 2019. View at: Publisher Site | Google Scholar
  70. J. Lin, S. Pan, W. Zheng, and Z. Huang, “Polarization-resolved second-harmonic generation imaging for liver fibrosis assessment without labeling,” Applied Physics Letters, vol. 103, no. 17, article 173701, 2013. View at: Publisher Site | Google Scholar
  71. G. Latour, I. Gusachenko, L. Kowalczuk, I. Lamarre, and M. C. Schanne-Klein, “In vivo structural imaging of the cornea by polarization-resolved second harmonic microscopy,” Biomedical Optics Express, vol. 3, no. 1, pp. 1–15, 2012. View at: Publisher Site | Google Scholar
  72. F. J. Ávila, O. del Barco, and J. M. Bueno, “Quantifying external and internal collagen organization from Stokes-vector-based second harmonic generation imaging polarimetry,” Journal of Optics, vol. 19, no. 10, article 105301, 2017. View at: Publisher Site | Google Scholar
  73. O. Nadiarnykh and P. J. Campagnola, “Retention of polarization signatures in SHG microscopy of scattering tissues through optical clearing,” Optics Express, vol. 17, no. 7, pp. 5794–5806, 2009. View at: Publisher Site | Google Scholar
  74. S. Jiao and L. V. Wang, “Jones-matrix imaging of biological tissues with quadruple-channel optical coherence tomography,” Journal of Biomedical Optics, vol. 7, no. 3, pp. 350–358, 2002. View at: Publisher Site | Google Scholar
  75. I. Gusachenko, G. Latour, and M. C. Schanne-Klein, “Polarization-resolved second harmonic microscopy in anisotropic thick tissues,” Optics Express, vol. 18, no. 18, pp. 19339–19352, 2010. View at: Publisher Site | Google Scholar
  76. V. Tuchin, Optical Clearing of Tissues and Blood, vol. 154, SPIE Press, Bellingham, WA, 2006.
  77. R. LaComb, O. Nadiarnykh, S. Carey, and P. J. Campagnola, “Quantitative second harmonic generation imaging and modeling of the optical clearing mechanism in striated muscle and tendon,” Journal of Biomedical Optics, vol. 13, article 021109, 2008. View at: Publisher Site | Google Scholar
  78. N. Olivier, F. Aptel, K. Plamann, M. C. Schanne-Klein, and E. Beaurepaire, “Harmonic microscopy of isotropic and anisotropic microstructure of the human cornea,” Optics Express, vol. 18, no. 5, pp. 5028–5040, 2010. View at: Publisher Site | Google Scholar
  79. G. Bautista, S. G. Pfisterer, M. J. Huttunen et al., “Polarized THG microscopy identifies compositionally different lipid droplets in mammalian cells,” Biophysical Journal, vol. 107, no. 10, pp. 2230–2236, 2014. View at: Publisher Site | Google Scholar
  80. M. Zimmerley, P. Mahou, D. Débarre, M.-C. Schanne-Klein, and E. Beaurepaire, “Probing ordered lipid assemblies with polarized third-harmonic-generation microscopy,” Physical Review X, vol. 3, no. 1, article 011002, 2013. View at: Publisher Site | Google Scholar
  81. L. Kontenis, M. Samim, S. Krouglov, and V. Barzda, “Third-harmonic generation Stokes-Mueller polarimetric microscopy,” Optics Express, vol. 25, no. 12, pp. 13174–13189, 2017. View at: Publisher Site | Google Scholar
  82. J. Morizet, G. Ducourthial, W. Supatto et al., “High-speed polarization-resolved third-harmonic microscopy,” Optica, vol. 6, no. 3, pp. 385–388, 2019. View at: Publisher Site | Google Scholar
  83. J. Mertz and L. Moreaux, “Second-harmonic generation by focused excitation of inhomogeneously distributed scatterers,” Optics Communication, vol. 196, no. 1-6, pp. 325–330, 2001. View at: Publisher Site | Google Scholar
  84. R. LaComb, O. Nadiarnykh, S. S. Townsend, and P. J. Campagnola, “Phase matching considerations in second harmonic generation from tissues: effects on emission directionality, conversion efficiency and observed morphology,” Optics Communication, vol. 281, no. 7, pp. 1823–1832, 2008. View at: Publisher Site | Google Scholar
  85. R. Chaudhary, K. R. Campbell, K. B. Tilbury et al., “Articular cartilage zonal differentiation via 3D second-harmonic generation imaging microscopy,” Connective Tissue Research, vol. 56, no. 2, pp. 76–86, 2015. View at: Publisher Site | Google Scholar
  86. G. Hall, K. W. Eliceiri, and P. J. Campagnola, “Simultaneous determination of the second-harmonic generation emission directionality and reduced scattering coefficient from three-dimensional imaging of thick tissues,” Journal of Biomedical Optics, vol. 18, no. 11, article 116008, 2013. View at: Publisher Site | Google Scholar
  87. R. Lacomb, O. Nadiarnykh, and P. J. Campagnola, “Quantitative second harmonic generation imaging of the diseased state osteogenesis imperfecta: experiment and simulation,” Biophysical Journal, vol. 94, no. 11, pp. 4504–4514, 2008. View at: Publisher Site | Google Scholar
  88. C. P. Crum, R. Drapkin, A. Miron et al., “The distal fallopian tube: a new model for pelvic serous carcinogenesis,” Current Opinion in Obstetrics & Gynecology, vol. 19, no. 1, pp. 3–9, 2007. View at: Publisher Site | Google Scholar
  89. A. Kaldawy, Y. Segev, O. Lavie, R. Auslender, V. Sopik, and S. A. Narod, “Low-grade serous ovarian cancer: a review,” Gynecologic Oncology, vol. 143, no. 2, pp. 433–438, 2016. View at: Publisher Site | Google Scholar
  90. K. R. Campbell and P. J. Campagnola, “Wavelength-dependent second harmonic generation circular dichroism for differentiation of Col I and Col III isoforms in stromal models of ovarian cancer based on intrinsic chirality differences,” The Journal of Physical Chemistry. B, vol. 121, no. 8, pp. 1749–1757, 2017. View at: Publisher Site | Google Scholar
  91. N. Bloembergen and Y. R. Shen, “Quantum-theoretical comparison of nonlinear susceptibilities in parametric media, lasers, and Raman lasers,” Physical Review, vol. 133, no. 1A, pp. A37–A49, 1964. View at: Publisher Site | Google Scholar
  92. D. Debarre, N. Olivier, and E. Beaurepaire, “Signal epidetection in third-harmonic generation microscopy of turbid media,” Optics Express, vol. 15, no. 14, pp. 8913–8924, 2007. View at: Publisher Site | Google Scholar
  93. M. Strupler, A. M. Pena, M. Hernest et al., “Second harmonic imaging and scoring of collagen in fibrotic tissues,” Optics Express, vol. 15, no. 7, pp. 4054–4065, 2007. View at: Publisher Site | Google Scholar
  94. D. C. Tai, N. Tan, S. Xu et al., “Fibro-C-Index: comprehensive, morphology-based quantification of liver fibrosis using second harmonic generation and two-photon microscopy,” Journal of Biomedical Optics, vol. 14, no. 4, article 044013, 2009. View at: Publisher Site | Google Scholar
  95. E. C. Rentchler, K. L. Gant, R. Drapkin, M. Patankar, and P. J. Campagnola, “Imaging collagen alterations in STICs and high grade ovarian cancers in the fallopian tubes by second harmonic generation microscopy,” Cancers, vol. 11, no. 11, p. 1805, 2019. View at: Publisher Site | Google Scholar
  96. J. S. Bredfeldt, Y. Liu, C. A. Pehlke et al., “Computational segmentation of collagen fibers from second-harmonic generation images of breast cancer,” Journal of Biomedical Optics, vol. 19, no. 1, article 16007, 2014. View at: Publisher Site | Google Scholar
  97. A. M. Stein, D. A. Vader, L. M. Jawerth, D. A. Weitz, and L. M. Sander, “An algorithm for extracting the network geometry of three-dimensional collagen gels,” Journal of Microscopy, vol. 232, no. 3, pp. 463–475, 2008. View at: Publisher Site | Google Scholar
  98. Y. Liu, A. Keikhosravi, G. S. Mehta, C. R. Drifka, and K. W. Eliceiri, “Methods for quantifying fibrillar collagen alignment,” Methods in Molecular Biology, vol. 1627, pp. 429–451, 2017. View at: Publisher Site | Google Scholar
  99. Z. Liu, K. P. Quinn, L. Speroni et al., “Rapid three-dimensional quantification of voxel-wise collagen fiber orientation,” Biomedical Optics Express, vol. 6, no. 7, pp. 2294–2310, 2015. View at: Publisher Site | Google Scholar
  100. Z. Liu, D. Pouli, D. Sood et al., “Automated quantification of three-dimensional organization of fiber-like structures in biological tissues,” Biomaterials, vol. 116, pp. 34–47, 2017. View at: Publisher Site | Google Scholar
  101. B. Wen, K. R. Campbell, K. Tilbury et al., “3D texture analysis for classification of second harmonic generation images of human ovarian cancer,” Scientific Reports, vol. 6, no. 1, article 35734, 2016. View at: Publisher Site | Google Scholar
  102. Y. Yu, J. Wang, C. W. Ng et al., “Deep learning enables automated scoring of liver fibrosis stages,” Scientific Reports, vol. 8, no. 1, article 16016, 2018. View at: Publisher Site | Google Scholar
  103. K. Tilbury and P. J. Campagnola, “Applications of second-harmonic generation imaging microscopy in ovarian and breast cancer,” Perspectives in Medicinal Chemistry, vol. 7, 2015. View at: Publisher Site | Google Scholar
  104. M. M. Lukina, V. V. Dudenkova, L. E. Shimolina, L. B. Snopova, E. V. Zagaynova, and M. V. Shirmanova, “In vivo metabolic and SHG imaging for monitoring of tumor response to chemotherapy,” Cytometry Part A, vol. 95, no. 1, pp. 47–55, 2019. View at: Publisher Site | Google Scholar
  105. S. Wu, Y. Huang, Q. Tang et al., “Quantitative evaluation of redox ratio and collagen characteristics during breast cancer chemotherapy using two-photon intrinsic imaging,” Biomedical Optics Express, vol. 9, no. 3, pp. 1375–1388, 2018. View at: Publisher Site | Google Scholar
  106. C. Williams, K. P. Quinn, I. Georgakoudi, and L. D. Black, “Young developmental age cardiac extracellular matrix promotes the expansion of neonatal cardiomyocytes in vitro,” Acta Biomaterialia, vol. 10, no. 1, pp. 194–204, 2014. View at: Publisher Site | Google Scholar
  107. C. Brackmann, M. Zaborowska, J. Sundberg, P. Gatenholm, and A. Enejder, “In situ imaging of collagen synthesis by osteoprogenitor cells in microporous bacterial cellulose scaffolds,” Tissue Engineering. Part C, Methods, vol. 18, no. 3, pp. 227–234, 2012. View at: Publisher Site | Google Scholar
  108. S. Sun, I. Titushkin, and M. Cho, “Regulation of mesenchymal stem cell adhesion and orientation in 3D collagen scaffold by electrical stimulus,” Bioelectrochemistry, vol. 69, no. 2, pp. 133–141, 2006. View at: Publisher Site | Google Scholar
  109. M. Pinsard, S. Laverty, H. Richard, J. Dubuc, M. C. Schanne-Klein, and F. Légaré, “Maturation of the meniscal collagen structure revealed by polarization-resolved and directional second harmonic generation microscopy,” Scientific Reports, vol. 9, no. 1, article 18448, 2019. View at: Publisher Site | Google Scholar
  110. W. Supatto, D. Débarre, B. Moulia et al., “In vivo modulation of morphogenetic movements in Drosophila embryos with femtosecond laser pulses,” Proceedings of the National Academy of Sciences of the United States of America, vol. 102, no. 4, pp. 1047–1052, 2005. View at: Publisher Site | Google Scholar
  111. D. Debarre, W. Supatto, A. M. Pena et al., “Imaging lipid bodies in cells and tissues using third-harmonic generation microscopy,” Nature Methods, vol. 3, no. 1, pp. 47–53, 2006. View at: Publisher Site | Google Scholar
  112. Y. H. Liao, S. Y. Chen, S. Y. Chou, P. H. Wang, M. R. Tsai, and C. K. Sun, “Determination of chronological aging parameters in epidermal keratinocytes by in vivo harmonic generation microscopy,” Biomedical Optics Express, vol. 4, no. 1, pp. 77–88, 2013. View at: Publisher Site | Google Scholar
  113. S. Y. Chen, S. U. Chen, H. Y. Wu, W. J. Lee, Y. H. Liao, and C. K. Sun, “In vivo virtual biopsy of human skin by using noninvasive higher harmonic generation microscopy,” IEEE Journal of Selected Topics in Quantum Electronics, vol. 16, no. 3, pp. 478–492, 2010. View at: Publisher Site | Google Scholar
  114. Y. H. Liao, Y. H. Su, Y. T. Shih, W. S. Chen, S. H. Jee, and C. K. Sun, “In vivo third-harmonic generation microscopy study on vitiligo patients,” Journal of Biomedical Optics, vol. 25, article 014504, 2019. View at: Publisher Site | Google Scholar
  115. S. Witte, A. Negrean, J. C. Lodder et al., “Label-free live brain imaging and targeted patching with third-harmonic generation microscopy,” Proceedings of the National Academy of Sciences of the United States of America, vol. 108, no. 15, pp. 5970–5975, 2011. View at: Publisher Site | Google Scholar
  116. Z. Zhang, J. C. de Munck, N. Verburg et al., “Quantitative third harmonic generation microscopy for assessment of glioma in human brain tissue,” Advanced Science, vol. 6, article 1900163, 2019. View at: Publisher Site | Google Scholar
  117. C. Sandeep, W. Pei-Che, C. Sheng-Tse, C. Ming-Jang, and S. Chi-Kuang, “In Tilte”. View at: Google Scholar
  118. G. N. Sanchez, S. Sinha, H. Liske et al., “In vivo imaging of human sarcomere twitch dynamics in individual motor units,” Neuron, vol. 88, no. 6, pp. 1109–1120, 2015. View at: Publisher Site | Google Scholar
  119. W. Liang, G. Hall, B. Messerschmidt, M. J. Li, and X. Li, “Nonlinear optical endomicroscopy for label-free functional histology in vivo,” Light: Science & Applications, vol. 6, no. 11, article e17082, 2017. View at: Publisher Site | Google Scholar
  120. J. C. Williams and P. J. Campagnola, “Wearable second harmonic generation imaging: the sarcomeric bridge to the clinic,” Neuron, vol. 88, no. 6, pp. 1067–1069, 2015. View at: Publisher Site | Google Scholar
  121. W. Liang, G. Hall, and X. Li, “Spectro-temporal dispersion management of femtosecond pulses for fiber-optic two-photon endomicroscopy,” Optics Express, vol. 26, no. 18, pp. 22877–22893, 2018. View at: Publisher Site | Google Scholar
  122. S. You, Y. Sun, E. J. Chaney et al., “Slide-free virtual histochemistry (part I): development via nonlinear optics,” Biomedical Optics Express, vol. 9, no. 11, pp. 5240–5252, 2018. View at: Publisher Site | Google Scholar
  123. I. Costantini, R. Cicchi, L. Silvestri, F. Vanzi, and F. S. Pavone, “In-vivo and ex-vivo optical clearing methods for biological tissues: review,” Biomedical Optics Express, vol. 10, no. 10, pp. 5251–5267, 2019. View at: Publisher Site | Google Scholar
  124. K. R. Campbell, B. Wen, E. M. Shelton et al., “3D second harmonic generation imaging tomography by multi-view excitation,” Optica, vol. 4, no. 10, pp. 1171–1179, 2017. View at: Publisher Site | Google Scholar

Copyright © 2021 Darian S. James and Paul J. Campagnola. Exclusive Licensee Suzhou Institute of Biomedical Engineering and Technology, CAS. Distributed under a Creative Commons Attribution License (CC BY 4.0).

 PDF Download Citation Citation
Views227
Downloads147
Altmetric Score
Citations