 Original Article
 Open access
 Published:
Sparseview tomography via displacement function interpolation
Visual Computing for Industry, Biomedicine, and Art volume 2, Article number: 13 (2019)
Abstract
Sparseview tomography has many applications such as in lowdose computed tomography (CT). Using undersampled data, a perfect image is not expected. The goal of this paper is to obtain a tomographic image that is better than the naïve filtered backprojection (FBP) reconstruction that uses linear interpolation to complete the measurements. This paper proposes a method to estimate the unmeasured projections by displacement function interpolation. Displacement function estimation is a nonlinear procedure and the linear interpolation is performed on the displacement function (instead of, on the sinogram itself). As a result, the estimated measurements are not the linear transformation of the measured data. The proposed method is compared with the linear interpolation methods, and the proposed method shows superior performance.
Introduction
Lowdose computed tomography (CT) can be achieved by using either lower current or fewer projection views. Sparseview tomography thus can find applications in lowdose CT [1]. Another application is in fast magnetic resonant imaging (MRI) when radial kspace sampling scheme is utilized [2]. In sparseview tomography, measurements are undersampled, which usually result in severe aliasing artifacts as streaking lines in the reconstructed images. The phrase “sparseview” means that the number of views in data acquisition is significantly smaller than the value that is met by Shannon’s sampling theorem, which requires [3].
where N_{p} is the number of views over 180° and D_{min} is the minimum number of detector bins to cover the object at one view. Many systematic studies lead to more efficient sampling criteria [4,5,6,7,8], where more complicated twodimensional interpolations are discussed.
According to compressed sensing theory, sparseview tomography may still be possible if some image domain constraints are used to compensate for the missing data [9,10,11,12,13,14,15]. However, this paper focuses on analytic filtered backprojection (FBP) reconstruction. Iterative reconstruction methods and machine learning methods are beyond the scope of this paper.
Sometimes the unmeasured views can be approximately estimated by interpolation methods [16,17,18,19]. Recently, machine learning methods are popular and successful in sparseview data estimation [20,21,22].
In this paper, we argue that interpolation with linear convolution approaches simply introduce slightly rotated images to the main image. By the “main” image, we imply the image that is reconstructed by only the measured sparse data. The results of machine learning methods depend on the training sets; therefore, the results may not be applicable to all applications. Here we propose a nonlinear method to estimate unmeasured projections by using displacement functions, which will be discussed in Section II. The linear interpolation method assumes that the unmeasured value is the average of its neighbors. On the other hand, the deformation method assumes that the unmeasured value has the same value as one of its neighbor’s value. The deformation method is nonlinear and is able to avoid or reduce the rotational interpolation artifacts. Comparison simulations will be presented in Section III, and Section IV concludes the paper.
Methods
The rotation effect of the linear interpolation method
As a simple example to illustrate the main motivation, this paper first considers a naïve linear interpolation approach that doubles the number of views in tomography. Let the sinogram be p(n, m), where p is the line integral of the object, n is the detector bin index and m is the view angle index. In this example, when m is odd, the p(n, m) is measured. When m is even, the p(n, m) is not measured and needs to be estimated. A simple linear interpolation scheme to estimate p(n, 2 m) from p(n, 2 m1) and p(n, 2 m + 1) is
The ultimate effect of this interpolation scheme is exaggeratingly illustrated in Fig. 1 as an outline drawing, where the undersampling streaking artifacts are not shown. Figure 1a shows the main image reconstructed from the original sinogram, while Fig. 1b shows the image reconstructed from the interpolated sinogram using (2). It is interesting to observe from Fig. 1b that the reconstructed image from the interpolated sinogram is a combination of three components: the main reconstruction using the original undersampled sinogram (with a weighting factor of 1), a rotated version of the main reconstruction by Δγ (with a weighting factor of 0.5), and a rotated version of the main reconstruction by Δγ (with a weighting factor of 0.5). Here 2Δγ is the angular gap between two adjacent views in the original undersampled sinogram.
An intuitive way to understand this phenomenon is to consider a different example that copies the available measurements at view 2 m + 1 to view 2 m, i.e., p(n, 2m) = p(n, 2m + 1). Using the extended sinogram, the reconstructed image will be the summation of two images: one is the original image and the other is a rotated version of the original image.
In general, sinogram interpolation via convolution yields an image that is a combination of the main reconstruction and some rotated versions of the main reconstruction. Similar phenomena are expected for other sinogram estimation methods that based on linear interpolation.
These two simple examples imply that in order to significantly improve the sinogram estimation, we must use some sort of nonlinearity. The idea of nonrigid deformation may be borrowed, altered, and applied to our sinogram estimation [23,24,25]. Another nonlinear way is to use sine wave approximation [17]. This paper proposes a displacement function interpolation method.
Use the deformation function for nonlinear interpolation
The main idea of our algorithm is illustrated below. A pair of measured sinogram views is provided: p(n, m_{1}) and p(n, m_{2}), where n is the index along the radial direction and m_{1} and m_{2} are two angular indices. The goal is to estimate p(n, m) with m between m_{1} and m_{2}.
The first step of the proposed method is to find a displacement function u(n) to connect p(n, m_{1}) and p(n, m_{2}) so that
It is desired to find a displacement function u(n) by minimizing the objective function
for each n. Since n is an index, we could require n(u) to be an integer.
It is fairly flexible how to define an objective function F. As another example, we can add the sign function of the finite difference to the objective function as.
where λ is a preset parameter to balance the weighting between constraints in the objective function F. We set λ = 0.01 in our implementation of (5). The purpose of the sign function is to encourage that the slopes of the deformed function p(n + u(n), m_{1}) and the target function p(n, m_{2}) have the same sign.
If we restrict u(n) to be integers in [−N, N] with N being a preset positive integer, it is efficient to evaluate the objection F with all possible u(n) values in [−N, N] and use a “min” function to determine the optimal displacement function u(n). Here, “min” is a builtin function in Matlab® to find the minimum value in an array. The motivation of using the “min” function instead of an iterative algorithm (such as the gradient decent algorithm) is to make the algorithm more efficient. The “min” function method only evaluates the deformed function 2 N + 1 times, while an iterative method evaluates the deformed function at least equal to the number of iterations, which is much greater than 2 N + 1.
After the displacement function u(n) is found, in the second step, the unmeasured sinogram p(n, m) with m between m_{1} and m_{2} can be readily obtained by linearly interpolating the displacement function u(n). For example, if m_{2} – m_{1} = M + 1, we can estimate M views between m_{1} and m_{2} as
for m = m_{1}, m_{1} + 1, …, m_{2} − 1. We must point out that in (6) n + u(n) × (m − m_{1})/M is most likely not an integer. Let
and
where ⌊x⌋ is the largest integer that is not greater than x. Then (6) cab be expressed as
for m = m_{1}, m_{1} + 1, …, m_{2} − 1.
An illustrative example for the proposed estimation procedure is shown in Fig. 2, where we have two sinogram measurements: p(n, 2 m + 1), as a broken curve, and p(n, 2 m1), as a solid curve. Our proposed algorithm discussed above gives a displacement function, u(n), as shown in Fig. 3, so that
The unmeasured p(n,2 m) is then estimated as
Since 0.5u(n) may not be an integer, linear interpolation is required as suggested by (9). Similarly, p(n, 2m) can be estimated by the measurement at view 2 m + 1 with a displacement function v(n), or by the combined measurements at both view 2 m1 and view 2 m + 1 as
Computer simulations and patient study
This proposed sinogram extension method was applied to two computer simulation cases and one real patient case. In the computer simulations, the image size was 256 × 256, and the detector size was 367. In this paper, the word “sinogram” is used in a general sense, and the “sinogram” can be parallel projections and can be fanbeam projections or in other geometries.
In computer simulations, the original undersampled sinogram was generated analytically without noise. We can better observe the image distortion in noiseless studies. In the first computer simulation study, the original measured number of views was 60 over 360°. After sinogram extension, the number of views was increased to 180 over 360°. In the second computer simulation study, the original measured number of views was 120 over 360°. After sinogram extension, the number of views was increased to 360 over 360°. The absolute error image between the estimated sinogram and the true sinogram was calculated and reported in the next section.
In the patient study, the sinogram data was obtained by a CT scan using 500 mAs. The detector was curved, and the imaging geometry was conebeam. The central slice of the conebeam data was used as the fanbeam data. The data set had 896 detector bins at one view and 1200 views over 360°.
In this paper, an undersampled data set was a subset of the original data set by using only 400 fanbeam views over 360°. After sinogram extension with displacement interpolation, there were 1200 views over 360°.
Sinogram estimation results using twoadjacentview linear interpolation was also obtained and reported in the next section.
The root mean square error (RMSE) between the reconstruction and the true image was calculated for all reconstruction images. The RMSE is defined as
where R_{i} is the reconstruction pixel value and Ti is the true image value. For the patient study, the true image was not available and is substituted by the reconstruction with the full data set using 1200 views.
For the comparison purposes, an iterative Landweber algorithm was also used in image reconstruction [26]. The iterative Landweber algorithm can be expressed as
where A is the projection matrix, A^{T} is the backprojection matrix, α is a relaxation parameter (or step size), P is the projection sinogram reformatted in the vector form, and X^{(k)} is the reconstructed image at the kth iteration reformatted in the vector form. The parameter α in this paper is chosen as 0.01.
Results
Rotation displacement artifacts due to sinogram linear interpolation
Linear interpolation between sinogram views is equivalent to linear combination of the images from the original sparseview reconstruction and rotated versions of the sparseview reconstruction. These effects are illustrated by an exaggerated sketch in Fig. 1. The rotational artifacts become more severe at locations away from the centerofrotation in the image. The observation of these artifacts motivated the investigation of a nonlinear sinogram interpolation method.
Using function deformation for sinogram interpolation
Figure 2 shows two curves p(n, m_{1}) and p(n, m_{2}), one being a solid curve and the other being a broken curve. These two curves represent two sinogram measurements at view indices m_{1} and m_{2}. A displacement function u(n) was estimate according to (3) so that the deformed version of one function approximately equal the other function (p(n, m_{2}) ≈ p(n + u(n), m_{1})) . The displacement function is shown in Fig. 3.
Using the displacement function u(n) for sinogram interpolation was realized as follows. A missing view at the angle exactly between the two measured views can be estimated by replacing u(n) by 0.5 × u(n).
Computer simulations
Figure 4 shows the results from the computer simulations with the FBP reconstruction algorithm. In this set, measurements from 360 views over 360° are considered as a full sinogram, and measurements from 60 views over 360° and 120 views over 360° are considered as undersampled. Figure 4a, b and c show the FBP reconstruction results from the full and undersampled sinograms, respectively. Fig. 4d, e and f show the results with linear convolution sinogram interpolation methods: sinc function interpolation and linear interpolation, as well as the proposed deformation method, respectively; the initial data set had 60 views. Figure 4g, h and i show the results with linear convolution sinogram interpolation methods: sinc function interpolation and linear interpolation, as well as the proposed deformation method, respectively; the initial data set had 120 views. The linear interpolation method is equivalent to the triangle function convolution method. Figure 4f and i show the results of the proposed nonlinear method.
There are two pairs of small blackandwhite dots in the phantom. The pair at the bottom is blurred more than the pair at the center be the estimation algorithms. We also observe that for the linear methods there is a circular region and the background noise texture is different within and outside this region.
The iterative Lanweber algorithm was used to reconstruct the image using undersampled data. The reconstruction results are shown in Fig. 5 for the data set with 60 views and the data set with 120 views, respectively.
The estimated sinograms and the true sinogram are compared in terms of the absolute value of the difference in Fig. 6 for the estimation methods used in Fig. 4. A summary of the absolute errors in the estimated sinograms is listed in Table 1. A summary of the RMSE in the FBP reconstructions is listed in Table 2. Table 3 lists the RMSE in the iterative reconstructions. The reconstruction errors for the iterative algorithm reconstructions depend on the iteration number, which is chosen by the user according to the applications. A lower iteration number gives a blurrier image, but less streaking artifacts.
There are two types artifacts: the undersampling streaking texture in the uniform areas and the blurry artifacts due to sinogram interpolation. The blurring artifacts can be easily detected by the pair of blackandwhite dots at the bottom of the image. All methods perform poorly for the data set that has only 60 views.
The study results using the patient CT data are shown in Figs. 7, 8, 9, 10, 11, 12. In this study set, measurements from 1200 views over 360° are considered as a full sinogram, and measurements from 400 views over 360° are considered as an undersampled sinogram. The detector had 896 bins for each view. The reconstructed image size was 800 × 800. Figure 7 shows the FBP reconstruction with this 1200view full data set and is considered to be the gold standard for other reconstructions to compare with.
Figure 8 shows the FBP reconstruction with 400 views. This image contains lots of streaking artifacts due to angular aliasing. For patient images, all images are displayed twice using two different display windows: [min, max] and [− 400, 400] Hounsfield units (HU).
Figure 9 shows the FBP reconstruction result from linear interpolation method. Severe rotation artifacts are observed in the image. The most severe rotation artifacts are observed at the outer regions inside the patient.
Figure 10 shows the result of proposed method that uses a nonrigid deformation technique. The rotation artifacts are no longer present. However, this image is not perfect. Compared with the gold standard shown in Fig. 7, some shadow artifacts are observed along the high contrast boundaries, and the spatial resolution is somewhat degraded.
In order to appreciate the improvements of the proposed method, a small rectangular sub region at the right part of the original image is cut out and is displayed in a larger format in Fig. 11 for images in Figs. 7, 8, 9, 10.
Figure 12 show three iterative reconstruction images obtained with 500, 1000, and 1500 iterations, respectively. The number of views was 400 over 360°. The image resolution improves as the number of iteration increases. At the 1500th iteration, the reconstructed image is still blurry. RMSEs for the iterative reconstrction results are presented in Table 4 for the patient study.
Conclusions
Fewview tomography in CT is an open problem. This paper made an observation that linear convolutionbased sinogram interpolation methods may produce rotational artifacts. To overcome this problem, this paper suggests a nonlinear method to estimate the unmeasured views. In this proposed method, two adjacent views in the original undersampled sinogram are used to estimate the missing views between them. A displacement function is estimated by a noniterative method. A fraction of the displacement function is used to estimate the missing views between the original measurements. One advantage of the proposed method is that the resultant FBP reconstruction using the estimated sinogram does not have the rotation artifacts. Our estimated sinogram is more accurate than the sinogram estimated by linear convolutionbased methods, which is demonstrated by the absolution errors as shown in Tables 1, 2 and 3.
In our patient study, there are 400 views over 360° and there are 896 bins on the detector. The number of view angles is extremely small, about 1/4.5 of the value required by the Shannon’s sampling theorem. The proposed algorithm produces fewer artifacts than the linear interpolation method as demonstrated in Fig. 11.
The iterative Lanweber algorithm is also used for the undersampled data image reconstruction. However, it requires a large number of iterations to produce high resolution images. At the 1500th iteration, the reconstructed image is still blurry.
When the number of views is extremely low, as in the computer simulation with 60 views, the proposed algorithm is not effective, and the reconstructed image is rather blurry even though the streaking artifacts are significantly reduced. It is still an open problem to effectively reconstruct an image with extremely undersampled data.
Availability of data and materials
Not applicable
Abbreviations
 CT:

Computed tomography
 FBP:

Filtered backprojection
 HU:

Hounsfield units
References
McCollough CH, Primak AN, Braun N, Kofler J, Yu L, Christner J (2009) Strategies for reducing radiation dose in CT. Radiol Clin N Am 47(1):27–40. https://doi.org/10.1016/j.rcl.2008.10.006
Adluru G, McGann C, Speier P, Kholmovski E, Shaaban A, Dibella E (2009) Acquisition and reconstruction of undersampled radial data for myocardial perfusion magnetic resonance imaging. J Magn Reson Imaging 29:466–473. https://doi.org/10.1002/jmri.21585
Buzug TM (2010) Computed tomography: from photon statistics to modern conebeam CT. SpringerVerlag, Berlin Heidelberg
Faridani A (2004) Sampling Theory and ParallelBeam Tomography. In: Benedetto JJ, Zayed AI, (eds) Sampling, Wavelets, and Tomography. Applied and Numerical Harmonic Analysis. Birkhäuser, Boston, MA. https://doi.org/10.1007/9780817682125_9
Faridani A (2006) Fanbeam tomography and sampling theory. Proceedings of Symposia in Applied Mathematics. 63. https://doi.org/10.1090/psapm/063/2208236
Natterer F (2001) The Mathematics of Computerized Tomography. Society for Industrial and Applied Mathematics. https://doi.org/10.1137/1.9780898719284
Natterer F (1993) Sampling in fanbeam tomography. SIAM J Appl Math 53(2):358–380
Rattey P, Lindgren A (1981) Sampling the 2D radon transform. IEEE Trans ASSP 29(5):994–1002
Sidky EY, Pan X (2008) Image reconstruction in circular conebeam computed tomography by constrained, totalvariation minimization. Phys Med Biol 53(17):4777–4807
Abbas S, Min J, Cho S (2013) Supersparsely viewsampled conebeam CT by incorporating prior data. J XRay Sci Technol 21(1):71–83
Huang J, Zhang Y, Ma J, Zeng D, Bian Z, Niu S, Feng Q, Liang Z, Chen W (2013) Iterative image reconstruction for sparseview CT using normaldose image induced total variation prior. PLoS One 8(11):e79709
Zheng Z, Hu Y, Cai A, Zhang W, Li J, Yan B, Hu G (2019) Fewview computed tomography image reconstruction using mean curvature model with curvature smoothing and surface fitting. IEEE Trans Nucl Sci 66(2):585–596. https://doi.org/10.1109/TNS.2018.2888948
Jones GA, Huthwaite P (2018) Limited view Xray tomography for dimensional measurements. NDT & E Int 93:98–109. https://doi.org/10.1016/j.ndteint.2017.09.002
Vlasov VV, Konovalov AB, Kolchugin SV (2018) Hybrid algorithm for fewviews computed tomography of strongly absorbing media: algebraic reconstruction, TVregularization, and adaptive segmentation. J Electron Imag 27(4):043006. https://doi.org/10.1117/1.JEI.27.4.043006
de Molina C, Serrano E, GarciaBlas J, Carretero J, Desco M, Abella M (2018) GPUaccelerated iterative reconstruction for limiteddata tomography in CBCT systems. BMC Bioinformatics 19:171. https://doi.org/10.1186/s1285901821693
Brooks RA, Weiss GH, Talbert AJ (1978) A new approach to interpolation in computed tomography. J Comput Assist Tomography 2(5):577–585
Siltanen S, Kalke M (2014) Sinogram interpolation method for sparseangle tomography. Appl Math 5(1):423–441. https://doi.org/10.4236/am.2014.53043
Bertram M, Wiegert J, Schafer D, Aach T, Rose G (2009) Directional view interpolation for compensation of sparse angular sampling in conebeam CT. IEEE Trans Med Imaging 28:1011–1022
Zhang H, Sonke JJ (2013) Directional sinogram interpolation for sparse angular acquisition in conebeam computed tomography. J Xray Sci Technol 21:481–496
Lee H, Lee J, Kim H, Cho B, Cho S (2019) Deepneuralnetwork based sinogram synthesis for sparseview CT image reconstruction. IEEE Trans Rad Plasma Med Sci 3(2):109–119
Liang K, Yang H, Kang K, Xing Y (2018) Improve angular resolution for sparseview CT with residual convolutional neural network. Proc SPIE Med Imag 10573:105731K. https://doi.org/10.1117/12.2293319
Lee D, Choi S, Kim HJ (2018) High quality imaging from sparsely sampled computed tomography data with deep learning and wavelet transform in various domains. Med Phys 46(1):104–115. https://doi.org/10.1002/mp.13258
Rao A, Chandrashekara R, SanchezOrtiz GI, Mohiaddin R, Aljabar P, Hajnal JV, Puri BK, Rueckert D (2004) Spatial transformation of motion and deformation fields using nonrigid registration. IEEE Trans Med Imaging 23(9):1065–1076
Thirion JP (1998) Image matching as a diffusion process: an analogy with Maxwell’s demons. Med Image Anal 2(3):243–260
Wang H, Dong L, O’Daniel J, Mohan R, Garden AS, Ang KK, Kuban DA, Bonnen M, Chang JY, Cheung R (2005) Validation of an accelerated ‘demons’ algorithm for deformable image registration in radiation therapy. Phys Med Biol 50:2887–2905
Landweber L (1951) An iteration formula for Fredholm integral equations of the first kind. Am J Math 73:615–624
Acknowledgments
The authors thank Raoul M.S. Joemai of Leiden University Medical Center for collecting and providing us raw clinical data.
Funding
This research is partially supported by NIH grant R15EB024283.
Author information
Authors and Affiliations
Contributions
All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Zeng, G.L. Sparseview tomography via displacement function interpolation. Vis. Comput. Ind. Biomed. Art 2, 13 (2019). https://doi.org/10.1186/s4249201900247
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s4249201900247