CytoSpec - an APPLICATION FOR HYPERSPECTRAL IMAGING |
||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||
|
|
|
|||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||
PULL DOWN MENU "IMAGE MANIPULATION" |
||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||
CHEMICAL IMAGING |
||||||||||||||||||||||||||||||
Chemical Imaging (or functional group mapping): This function permits to produce chemical images, which display defined spectral parameters such as absorbances at a given frequency as a function of the spatial position. Spectral parameters are color encoded according to the selected Colormap. In the CytoSpec program you can use the following methods for chemical imaging:
Method B: obtains the absorbance value at a given frequency P1 Method C: calculates the integrated area in the region P1, P2 (trapezoidal baseline correction) Method D: obtains a baseline corrected absorbance value at a given frequency P5. The baseline is obtained from the points P1 and P2 Methods A-D/E-H: calculate ratios using any combination of methods for two regions or absorbances at a given frequency
|
||||||||||||||||||||||||||||||
FREQUENCY IMAGING / FREQUENCY MAPS |
||||||||||||||||||||||||||||||
Frequency imaging: This function permits visualization of peak positions, and their variations, within hyperspectral maps. Band positions - either maxima or minima - are obtained and plotted as a function of the spatial coordinates. Band positions can be obtained from all types of data blocks, including also derivative spectra (for details refer to chapter Internal Data Organization). Two different methods of the 'frequency map' routine are available: Peak maxima/minima can be obtained from spectra contained in one of the four data blocks, or for overlapping bands from second derivative data blocks (this may also be second derivatives from spectra of the derivative data block!). The use of second derivatives for peak picking may be useful for the detection of peaks in the presence of strongly overlapping signals, i.e. when the band is only a small shoulder on a strong signal. To some extent 2nd derivatives compensate also for baseline effects. Derivatives should be used with care as noise is considerably amplified. The algorithm of the peak picking routine works as follows: A. If the option 'obtain peak positions from derivatives' was NOT selected:
2. If the option 'search maxima' was checked, the algorithm is then searching for the x-positions (frequencies) of the maxima within the spectral region indicated by the user. If minima are chosen, the program is searching for minima. IMPORTANT: If band positions are obtained from the data block of derivate spectra, maxima appear in second derivative spectra as minima and vice versa. There is no check for i) the order of the derivative and consequently ii), no compensation for the inversion of maxima and minima! 3. The frequency values of the maxima/minima are color scaled and plotted as a function of the spatial coordinates. If you wish to further analyze the band positions by other programs you can access the data matrix of frequency values by using the Export Maps function.
Calculation of Derivative Spectra). 2. Derivative spectra are interpolated. For interpolation, the spline method is used. Interpolation is carried out in the frequency range indicated in the edit fields 'select spectral region for peak search'. Furthermore, a factor of interpolation can be selected. This factor indicates how many times the number of data points will be increased upon interpolation in the spectral region selected for peak picking. 3. If the option 'search maxima' was checked, the algorithm is then searching for the x-positions (frequencies) of the maxima within the spectral region indicated by the user. If minima are chosen, the program is searching for minima. IMPORTANT: If band positions are obtained from the data block of derivate spectra, maxima appear in second derivative spectra as minima and vice versa. There is no check for i) the order of the derivative and consequently ii) no compensation for the inversion of maxima and minima! 4. The frequency values of the maxima/minima are color scaled and plotted as a function of the spatial coordinates. If you wish to further analyze the band positions by other programs you can access the data matrix of frequency values by using the Export Maps function.
|
||||||||||||||||||||||||||||||
HCA Imaging |
||||||||||||||||||||||||||||||
Hierarchical Cluster Analysis (HCA): This imaging function performs hierarchical cluster analysis of hyperspectral data and can be used to display the results as HCA images and dendrograms. Spectra with negative Quality Test results, or unselected Regions of Interest are excluded from the analysis and appear in HCA images as black pixels. For each spectral class, or cluster, average spectra and standard deviation spectra are calculated which can be stored in an ASCII data format. Furthermore, it is also possible to store, or load, distance data and the results of hierarchical clustering. ![]()
Multivariate Statistics --> hierarchical clustering (HCA) . HCA images should be produced directly from the hyperspectral data.
obtaining inter-spectral distances for clusteringPart II - Hierarchical clustering.Part III - HCA imaging: reassembling HCA images, obtaining mean cluster spectra.Part IV - an example of HCA imaging.
calc: starts the calculation of the distance matrix. load: load distance matrix files (file extensions is '*.dis'). save: save the distance matrix. use shortcut: if this option is chosen, the calculation of the distance matrix AND hierarchical clustering are queued that is no further user input will be required. Please select a distance AND a cluster method, even if the distance matrix has not been obtained, before pressing the 'calc' button. Note also that the distance matrix cannot be stored when this option was selected. reduced HCA: This HCA imaging option is particularly useful when large datasets are analyzed. It is recommended to choose this option for data files containing more than 128 x 128 spectra. In reduced HCA, the calculation of the distance matrix and hierarchical clustering are carried out on the basis of randomly selected spectra. When finished, mean cluster spectra of the last 50 clusters are obtained. Then, distance method: pop up menu which allows to select one of the following methods for distance matrix calculation.
load: load cluster analysis files. The file extension is '*.cls'. save: save cluster analysis results. cluster method: here you can select a method for clustering:
image: displays the cluster image. The number of classes (clusters) are color encoded. The color sequence is determined by the active color map, usually the color map 'ann' (see function Display Spectra).dendro: A dendrogram is shown on the display. The dendrogram can be stored as bitmap ('*.bmp') or as an encapsulated postscript ('*.eps') data file. Both functions are available by a activating the context menu of the dendrogram window. Note that dendrograms will show only the last 500 fusion steps. spectra: this function produces and displays average spectra of each class. After clicking on the 'spectra' button, a dialog box for choosing the source data block comes up (see screenshot below). This data block is then used for averaging and the creation of the respective standard deviation spectra.
disp averages: average spectra of the selected data block are calculated and plotted in the same color like in the cluster map. save averages: average and standard deviation spectra of the selected data block are calculated. To store these spectra (double column ASCII) use the standard windows dialog box to set the path and chose a file name. Average spectra and standard deviation spectra of the i-th cluster are stored per default in separate files (corename_i - for average spectra and corename_std_i for the standard deviation spectra). Part IV - Example of HCA imaging:
Min-Max Normalized average spectra, which were encoded by the same color utilized for displaying the cluster in the HCA image (HCA was carried out on the basis of the file 'colon.cyt'. which can be found in the /testdata/bin/CytoSpec/ directory).Reference to the literature: Lasch P, Haensch W, Naumann D, Diem M. Imaging of colorectal adenocarcinoma using FT-IR microspectroscopy and cluster analysis. Biochim Biophys Acta. 2004 1688(2):176-86. Lasch P, Diem M, Hänsch W & Naumann D. [2007] Artificial neural networks as supervised techniques for FT-IR microspectroscopic imaging. Journal of Chemometrics Vol. 20(5):209-220. |
||||||||||||||||||||||||||||||
PCA Imaging |
||||||||||||||||||||||||||||||
Principles of PCA: PCA is a linear transformation in which the (spectral) data are transferred into a new coordinate system. In this new coordinate system, the largest data variance points to the direction of the first coordinate, which is also called the first principal component (pc), the second largest variance on the second pc, and so forth. PCA is therefore a transformation that re-arranges the data according to the data's intrinsic variance: most of the variance is contained in the lower-order principal components while higher-order pc's are supposed to contain mainly noise. Reduction of dimensionality by PCA can be effectively achieved by omitting higher-order principal components. Related web links (Wikipedia):
|
||||||||||||||||||||||||||||||
3D FOURIER SELF-DECONVOLUTION (FSD) |
||||||||||||||||||||||||||||||
This function allows Fourier self-deconvolution in the two spatial dimensions (x and y) and the spectral/frequency dimensions (z) to be performed at the same time. The method can be applied to enhance the spectral and/or spatial resolution and to increase the image contrast. Adapted from the 1-D algorithm described in: J.K. Kauppinen, D.J. Moffat, H.H. Mantsch, D.G. Cameron, Fourier Self-Deconvolution: a method for resolving intrinsically overlapped bands. Appl Spectrosc. 35(3) 1981. 271-276. J.K. Kauppinen, D.J. Moffat, H.H. Mantsch, D.G. Cameron, Self-deconvolution and first order derivatives using Fourier transforms. Anal Chem. 53(9) 1981. 1454-1457. J.K. Kauppinen, D.J. Moffat, H.H. Mantsch, D.G. Cameron, Noise in Fourier self-deconvolution. Appl. Opt. 20(3) 1981. 1866-.
The k-factor must lie between 0 and 0.95: then larger k, then more the data are smoothed. You can apply different smoothing factors for the spatial (k factor x or y) and spectral dimensions (k factor z). Gamma (the half width at half peak height, gamma > 0) is a parameter of the exponential part of the deconvolution function. The higher gamma, the higher the power of deconvolution. The peak width value reported by this program actually refers to the REDUCTION in the width of the original peaks in the data. Therefore, a reported width value of 8 means that a peak of approx. width 10 before FSD, will have a width of 2 afterwards. Important : 3D Fourier self-deconvolution can be performed only on the original data (data block 1). This function is only suited for envelopes much broader than the spatial/spectral resolution. Avoid oscillatory patterns due to over-deconvolution! Reference to the literature: |
||||||||||||||||||||||||||||||
ANN IMAGING |
||||||||||||||||||||||||||||||
This function of the CytoSpec program is designed to re-assemble hyperspectral images on the basis of classification results of artificial neural networks (ANN). In this function, result files (*.res) of the Stuttgart Neural Network Simulator (SNNS) are analyzed and directly converted into false-colored ANN maps. Furthermore, checks for activation thresholds and multiple activations can be carried out. The Network Simulator was developed at the "Institut für Parallele und Verteilte Höchstleistungsrechner" (IPRV) of the Universität Stuttgart (Germany). The SNNS can downloaded for free at ftp://ftp.informatik.uni-stuttgart.de.
|
||||||||||||||||||||||||||||||
Imaging by using Synthon's NeuroDeveloper(TM) network simulator |
||||||||||||||||||||||||||||||
The evaluation of the activations calculated by the network is performed with the analysis functions WTA and 40-20-40. For this evaluation the scores and the distribution of the activations from the output neurons are taken into account. WTA criteria: WTA stands for winner takes all, which means the classification depends on the highest output activation. A spectrum will only be classified if its output is greater than the defined minimum activation of winner neuron (default 0.7) and the minimum distance to next activation (default 0.3). Otherwise the classification will not be considered correctly and the spectrum remains unclassified. '406040' criteria The 40-20-40 function works differently. The activation of one neuron has to exceed 0.6 (default, above 60 percent of the activation range). All other activations of further classes have to be below 0.4 (below 40 percent of the activation range). Otherwise, the pattern remains unclassified. 'extrapolation' criterion A general problem with different classification methodologies is the potential misclassification due to undesired or unexpected extrapolation. This occurs, when the training and validation datasets do not comprise all classes or the entire range of a feature needed for a given classification problem. In this case, any classification method, including ANNs, would not be representative for the given problem. Data of this type should rather be termed not classified. The NeuroDeveloper uses a distance value derived from the training and validation dataset, to determine an extrapolation problem. The maximum distance of a pattern to its corresponding class is calculated and set to 100. During the classification of a new pattern by the ANN, the distance of the new pattern is calculated and set into relation. In case the calculated extrapolation value of the class, identified by the neural network, exceeds 100, an extrapolation occurs. The default value to determine patterns as unclassified is proposed to be set to 200. The value should be set greater than 100, the smaller the value, the stricter the threshold. Please note If the checkbox 'use NeuroDeveloper winner assignments' was checked, CytoSpec does not perform an analysis of the WTA, 406040 and extrapolation results. The NeuroDeveloper software excludes spectra from further analysis in the following way: 1. either both, the WTA, or the 406040 criteria are failed. 2. failed classification based on the extrapolation criterion The definition of 'failed classifications' in CytoSpec is different. CytoSpec defines spectra as unclassified if an individual spectrum failed one of the three criteria. For this reasons, the classification statistics may depend on the program used for analysis. Screenshot of the NeuroDeveloper(TM) classification statistics window: The network file (*.snt) contains all relevant information for pre-processing and classification. This file, and Synthons's run-time environment (NOT the NeuroDeveloper!) are required for classification. B. Produce NeuroDeveloper maps (e.g. for external validation) |
||||||||||||||||||||||||||||||
chemical maps (chemical imaging or functional group mapping)
frequency maps (imaging based on band frequencies)
3D deconvolution (image re-assembling based on 3D Fourier self-deconvolution)
HCA maps (image re-assembling based on hierarchical clustering)
PCA maps (image re-assembling based on principal component analysis)
Synthon imaging (image re-assembling based on Synthon's NeuroDeveloper(TM) ANN simulator)
ANN maps (image re-assembling based on artificial neural network analysis)
Main Window - Basics Concepts.)
Manipulating the colormap used for imaging (change colormap, change color contrast/offset)
How to save spectral images as bitmaps?
How to export the map data (absorbance/transmittance/Raman intensities) as ASCII-tables?
How to produce hyperspectral maps (Basics)
Working with vibrational spectra - basic concepts
Manipulating the colormap used for imaging (change colormap, change color contrast/offset)
How to save spectral images as bitmaps?
How to export the map data (absorbance/transmittance/Raman intensities) as ASCII-tables?
How to produce hyperspectral maps (Basics)
Working with vibrational spectra - basic concepts
Multivariate Statistics --> PCA maps if you want to produce PCA images directly from a hyperspectral data set.
Quality Test results, or unselected
Regions of Interest are excluded from the analysis and appear in PCA images as black pixels.
log-file) you can find additional information on the test results.
Lasch, P. & Naumann, D. FT-IR Microspectroscopic Imaging of Human Carcinoma Thin Sections Based on Pattern Recognition Techniques. Cellular and Molecular Biology 1998 44(1). pp. 189-202
Lasch P, Haensch W, Kidder L, Lewis EN. Naumann D. [2002] Colorectal Adenocarcinoma Characterization by Spatially Resolved FT-IR Microspectroscopy. Appl. Spectrosc. 2002 56 (1). 1-9 |
Synthon GmbH, contact address: Analytics and Pattern Recognition Im Neuenheimer Feld 69120 Heidelberg GERMANY phone: +49 6221 50 257 900 fax: +49 6221 50 257 909 email: info@synthon-analytics.com internet: http://www.synthon-analytics.de |
|
![]()
|
load allows to browse the directory structure and load the NeuroDeveloper network library (*.snt) file. After loading the 'image' and 'stats' buttons are activated.
|
| 1. | Load an IR data set and produce an IR spectral map (e.g. chemical map, HCA map) |
| 2. | Obtain the context menu of IR maps by clicking with the right mouse button over the infrared spectral map. |
| 3. | Choose 'class 1' --> and 'start' if you want to assign spectra to class 1. Now, you are in the 'select spectra' mode. In this mode, the mouse cursor changes its appearance (arrow plus cross). |
| 4. | You can select now an unlimited number of spectra by left mouse clicks (in this mode; spectra will be not displayed). The spatial coordinates will be given in the command line window. |
| 5. | To stop the selection mode, choose 'selection mode off' from the context menu. Alternatively, you can immediately start to assign spectra to class 2 by selecting 'class 2' --> and 'start' from the context menu. In this way, spectra can be assigned to up to 10 distinct classes. |
| 6. | If all spectra are selected, stop the selection mode by 'selection mode off'. In the normal 'show spectra' mode the mouse pointer will regain its normal appearance (arrow). |
| 7. | In order to export spectra select the 'export' --> 'x,y ASCII' from the file pull down menu. A window with the title ' convert into a (x,y) ASCII data format' appears. Check the checkbox 'export selection'. Please use the default settings for all other options. Make sure, that the data block of original absorbance spectra is exported. |
| 8. | Press button 'export' and store the spectra in a folder of your choice. Spectra of class 1 can be identified by the extension '*_1.dat', spectra by class 2 are named '*_2.dat' and so forth. |
| 9. | Steps 1-8 should be repeated for a number of maps. It is recommended to use consistent class assignments for identical (histological) structures. |
| 10. | Split the spectral data into a subset for teaching (ca. 65 % of the spectra) and internal validation (35%) |
| 1. | Load an IR data set of absorbance spectra. It is recommended to produce first an IR map (e.g. chemical map) from original spectra. |
| 2. | Select 'Synthon maps' from the 'Image manipulation' pull down menu. A window entitled 'create NeuroDeveloper maps' will appear. Press the 'load' button and select one of NeuroDeveloper's Network files (*.snt). |
| 3. | Spectra from the data block of original data are now written to a temporary file (in CytoSpec's root folder, please make sure that sufficient free disk space is present). The data are then pre-processed and classified by Synthon's run-time environment. After this, the classification results are automatically transferred back to CytoSpec. When finished, you can immediately press the 'image' button that causes CytoSpec to display the NeuroDeveloper map. If you wish to modify the NeuroDeveloper exclusion criteria such as WTA, 406040, or extrapolation, uncheck the respective checkboxes and press 'define'. Change the settings, close the window and press 'image'. Classification statistics are available by pressing the 'stats' button of the 'create NeuroDeveloper maps' window. |
Copyright (c) 2000-2008 CytoSpec. All rights reserved.