Professional Documents
Culture Documents
com
Department of Computational Neuroscience, University Medical Center Hamburg-Eppendorf, 20246 Hamburg, Germany
b
Institute of Medical Informatics, University of Lbeck, 23538 Lbeck, Germany
c
Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, 20246 Hamburg, Germany
d
Department Computer Engineering, Faculty of Mathematics, Informatics and Natural Sciences, University of Hamburg,
22527 Hamburg, Germany
Received 2 January 2012; revised 16 July 2012; accepted 17 July 2012
Abstract
The aim of this work is to present and evaluate a level-set segmentation approach with vesselness-dependent anisotropic energy weights,
which focuses on the exact segmentation of malformed as well as small vessels from time-of-flight (TOF) magnetic resonance angiography
(MRA) datasets.
In a first step, a vesselness filter is used to calculate the vesselness dataset, which quantifies the likeliness of each voxel to belong to a
bright tubular-shaped structure and estimate the corresponding vessel directions from a given TOF dataset. The vesselness and TOF datasets
are then combined using fuzzy-logic and used for initialization of a variational level-set method. The proposed level-set model has been
extended in a way that the weight of the internal energy is locally adapted based on the vessel direction information. Here, the main idea is to
weight the internal energy lower if the gradient direction of the level-set is similar to the direction of the eigenvector extracted by the
vesselness filter. Furthermore, an additional vesselness force has been integrated in the level-set formulation.
The proposed method was evaluated based on ten TOF MRA datasets from patients with an arteriovenous malformation. Manual
segmentations from two observers were available for each dataset and used for quantitative comparison. The evaluation revealed that the
proposed method yields significantly better segmentation results than four other state-of-the-art segmentation methods tested. Furthermore,
the segmentation results are within the range of the inter-observer variation.
In conclusion, the proposed method allows an improved delineation of small vessels, especially of those represented by low intensities
and high surface curvatures.
2013 Elsevier Inc. All rights reserved.
Keywords: Magnetic resonance angiography; Cerebrovascular disorders; Fuzzy logic; Level-set segmentation
1. Introduction
Vascular diseases are a major cause of death and
disability worldwide and a large number of people suffer
from a cerebrovascular incidence each year. Besides
ischemic strokes, hemorrhages are the second major cause
for cerebral strokes and account for approximately 1020%
of all cases [1]. Most hemorrhages are thought to result from
the rupture of small vessels in the presence of long standing
Corresponding author. Tel.: +49 40 7410 59828; fax: +49 40 7410
54882.
E-mail address: n.forkert@uke.uni-hamburg.de (N.D. Forkert).
0730-725X/$ see front matter 2013 Elsevier Inc. All rights reserved.
http://dx.doi.org/10.1016/j.mri.2012.07.008
models [7], quantication of pathologies [8] and preoperative denition a vessel-free path needed for brain tumor
biopsies and deep brain stimulations in case of epilepsy and
Parkinson disease [9].
Due to the fact that the manual delineation of vessel
structures is time-consuming and error-prone, the automatic
segmentation of vascular structures has been in the focus of
research for several years. Numerous factors have to be taken
into consideration for the development of an automatic
segmentation approach. Among others, these factors include
the high complexity of vessel shapes, including diameter and
curvature, especially in case of pathological structures, as well
as noise and other imaging artifacts, different vessel contrasts,
the representation of surrounding organs and general aspects
like image dimension or resolution [10]. Therefore, a general
method that can extract the vascular system from any kind of
angiographic dataset is not available.
Due to the high blood-to-background contrast [11], the 3D
time-of-ight (TOF) magnetic resonance angiography
(MRA) is a commonly used MR imaging technique in
clinical practice for diagnosis of the cerebral vascular system
[12] and numerous vessel segmentation approaches have
been proposed in the past that can be used for delineation of
vessel structures from this image sequence. A rough overview
of the state-of-the-art of vessel segmentation techniques is
given in the following.
2. State-of-the-art
In general, typical state-of-the-art vessel segmentation
schemes can, for example, be distinguished into threshold-,
scale-space- and deformable-model-based methods as well
as hybrid approaches that combine two or more of these
basic techniques into one framework.
Threshold-based approaches aim to extract one global
threshold or locally adaptive thresholds for segmenting vessel
structures. One comparably simple and fast threshold-based
approach is the Z-buffer segmentation (ZBS) method as
described by Chapman et al. [13]. In this approach, a
maximum intensity projection of the 3D TOF dataset is
computed rst while the corresponding voxel coordinates are
saved in a Z-buffer image. After a consistency check of the Zbuffer, a set of seed points is extracted, which are used to
obtain the nal segmentation via volume growing. Another
volume-growing segmentation method was presented by Yi
and Ra [14]. Here, the 3D dataset is separated into several
cube-shaped sub-volumes, which are used to calculate locallyadaptive thresholds that are then applied in a volume-growing
process. Stochastic models are another common approach for
the extraction of a threshold. The basic idea of these models is
to extract the histogram of a given image and t a mixture of
statistical distributions that represent different tissues using the
Expectation Maximization (EM) algorithm [15]. Wilson and
Noble [16] proposed a stochastic model based on two
Gaussian distributions, one for modeling the cerospinal
263
uid, bone and background and the second for the brain
tissue and eyes, and one uniform distribution for arteries and
subcutaneous fat. Hassouna et al. [17] found that an improved
tting accuracy can be achieved if using four distributions. In
this work, a Rayleigh distribution was used to model the
background and three Gaussian distributions were used to
design the remaining tissue distributions, whereas the
Gaussian distribution modeling the high intensity region
corresponds to vascular structures. After thresholding, a
Markov random eld is employed in a post-processing step.
Intensity-based segmentation techniques are usually simple to
implement, fast and are able to delineate malformed vessels,
which are represented by high intensities. However, these
approaches tend to be sensitive for noise artifacts leading to
holes within the segmentation and leakages to non-vascular
tissues. Moreover, intensity-based approaches often fail to
segment small vessels that are represented by low intensities.
Scale-space-based methods are another common general
technique for cerebrovascular segmentation. Here, especially
line-lter methods [1820] have been used extensively in the
past. The main idea of these approaches is to convolve the
angiographic image with Gaussian derivatives of different
standard deviations to obtain information about the local
image geometry. The different scales are used to deal with
different vessel sizes. Commonly, the Hessian matrix is used
to obtain the required second-order derivative information
but the use of the Weingarten matrix has also been proposed
as an alternative [21]. Certain relations of the eigenvalues of
the matrix are used to discriminate tubular structures in the
image, while the corresponding eigenvectors can be used to
estimate the vessel orientation in space. The enhanced socalled vesselness images have been used for direct visualization [19], thresholding [18] or active contour segmentation
[20]. Scale-space approaches allow an improved small-vessel
extraction but usually fail to delineate malformed vessels,
which do not exhibit a typical tubular vessel shape.
Deformable-model-based approaches deform an initial
contour or surface by internal and external forces. Generally,
the internal forces keep the evolving contour smooth, while
the external energy drives the contour towards dened image
features. Due to the fact that the parameterization of active
contours is very challenging for vascular segmentation in
3D, implicit active contours such as level-sets are more
frequently used for this purpose. Several level-set vessel
segmentation schemes have been proposed in the past that
differ regarding the integration and extent of shape priors and
usage of gradient features or global intensity statistics. One
well known level-set segmentation approach that utilizes a
strong shape prior is the curve evolution method proposed by
Lorigo et al. [22]. The main idea of this approach is to evolve
line structures in the 3D image domain. To account for the
special characteristics of vessels, the width-limited surface is
evolved by constraining its lowest curvature. In contrast to
this, Vasilevskiy and Siddiqi proposed a level-set framework
for vascular segmentation that is based on ux-maximizing
ow [23]. Here, the main idea is to align the surface normal
264
265
Fig. 2. Slice from a TOF image sequence and 3D visualization of the rst eigenvectors calculated by the vesselness lter.
266
+ H xlogpBG F xdx;
where H denotes the Heaviside function, which is used to
describe inside and outside of the object. Using this
formulation an integration of a priori knowledge about
intensity distributions inside (pV) and outside (pBG) the
vessels becomes possible. These intensity distributions can
be estimated by sampling the fuzzy values inside and outside
an initial cerebrovascular segmentation using a ParzenWindow strategy [31] with Gaussian kernels:
!
1
1
ggi 2
pj g =
p exp
4
jGj j gi Gj 2
22
where j {V", BG"} and G denotes the set of sampled
fuzzy values.
More precisely, two thresholds were used in this work:
one for initialization of the level-set segmentation (init) and
one for estimating the fuzzy value probabilities (prob) with
the Parzen-Window technique. Higher values should be
preferred for init such that the initial segmentation contains
mostly true vessels. In contrast to this, lower thresholds are
recommended for prob, which is supposed to enable an
improved evolution into non-segmented vessels.
The internal energy is typically used to keep the object
boundaries smooth. However, small vessels are often
represented by low intensities and edge values. In such a
case, the internal energy is typically stronger than the
external energy, which may lead to an insufcient evolution
into small vessels, even in case of a low prob. One solution
to avoid this problem is to lower the weight for the internal
energy, which enables improved small vessel delineations
but also results in more leakages into non-vascular tissues.
Thus, a local adaption of the internal energy weight may lead
to an improved level-set evolution into small vessels while
preventing false-positive leakages into non-vascular tissues.
For this reason, the internal energy is dened in this work by:
| ; : = jj H xjjdx:
5
e1 x
1 jjxjj
2jABj
jAj + jBj
267
4. Results
Table 1 shows the results of the quantitative evaluation of
the segmentation results using the Dice-coefcient. Here, it
can be seen that the two observers agree with a mean Dicecoefcient D of 0.791 (standard deviation =0.039).
No signicant differences were found regarding the Dicecoefcients of the automatic segmentation methods compared to the manual segmentations of the two observers
(0.36bPb.87). Therefore, the mean Dice-coefcients D
stated in the following have been averaged over both
observers and all ten datasets.
The worst automatic segmentation results were achieved
by the ZBS method (D=0.55, =0.11). Compared to this, the
intensity-based SMS approach lead to signicantly better
cerebrovascular segmentation results (D=0.725, =0.081,
Pb.0001). However, on average all three remaining
segmentation methods using the fuzzy-image as input lead
to better segmentation results regarding the Dice-coefcient.
Comparing these three segmentation techniques, it becomes
apparent that both level-set segmentation techniques lead to
a quantitative improvement of the FIS (D=0.762, =0.038)
used for initialization of both techniques. A comparison of
the two level-set methods reveals that the CES algorithm
performed worse (D=0.783, =0.037) than the proposed
FLS with anisotropic energy weights (D=0.806, =0.028).
The FLS even lead to segmentation results, which are
slightly better than the determined inter-observer agreement.
Overall, the FLS performed signicantly better than any
other automatic segmentation approach tested in this study
(ZBS: Pb.0001, SMS: P=.0004, FIS: P=.048, CES: P=
.0004), while no signicant difference to the results of the
inter-observer comparison was found (P=.305).
Overall, the quantitative results show that the FLS lead to
the best segmentation results in 9 of the 10 datasets
Table 1
Quantitative results of the inter-observer comparison (IOC) and automatic vessel segmentations using the Dice-coefcient: ZBS, SMS, FIS, CES and FLS
Dataset
IOC
ZBS
SMS
FIS
CES
FLS
1
2
3
4
5
6
7
8
9
10
0.732
0.824
0.808
0.767
0.748
0.838
0.785
0.753
0.827
0.825
0.492
0.604
0.598
0.662
0.467
0.473
0.746
0.378
0.483
0.600
0.747
0.701
0.802
0.771
0.669
0.817
0.683
0.761
0.542
0.756
0.720
0.816
0.761
0.790
0.767
0.711
0.790
0.756
0.799
0.711
0.729
0.835
0.787
0.792
0.773
0.794
0.816
0.764
0.814
0.722
0.763
0.838
0.805
0.815
0.785
0.790
0.832
0.785
0.852
0.790
268
Fig. 4. 3D visualizations from the axial and sagittal view using volume rendering of one selected TOF dataset masked with the two manual segmentations (rst
row), Z-buffer (second row, left) and stochastic model segmentation (second row right), fuzzy image (third row, left) and Curve-Evolution segmentation (third
row, right) and fuzzy-level-set segmentation (last row).
269
Table 2
Number of voxels segmented belonging to small vessel structures with a maximal diameter of 0.5 mm for the manual and automatic segmentations
Dataset
IOC
ZBS
SMS
FIS
CES
FLS
1
2
3
4
5
6
7
8
9
10
106482
116061
90638
99450
113376
87046
61541
69327
73461
91901
32858
36825
32517
33416
28258
22765
27681
12023
24989
33497
81284
113204
60317
73353
96776
38300
49467
46615
102882
69935
101022
114445
92085
90595
105975
47430
51939
74430
65835
79106
46065
52349
46207
43218
52163
39963
41040
34372
28186
38282
104703
122169
92071
100586
112706
44518
56885
83222
66430
83306
5. Discussion
The concurrent and exact delineation of small and
malformed vessels is a very challenging task for automatic
methods as well as human observers. It was previously
reported by Nowinski et al. [35] that the sensitivity for small
vessel extraction using their method is as low as 16.5% and it
was estimated that a manual renement would take 8 weeks.
Therefore, perfect ground-truth segmentations are usually not
available for typical clinical datasets. To the authors'
knowledge, an evaluation of inter-observer agreement for
cerebrovascular segmentations has not been performed to date.
The inter-observer agreement evaluation based on ten TOF
datasets performed in this study revealed a mean Dicecoefcient of 0.791, which seems like a good result regarding
the fact that overlap measures are known to be not optimal for
thin structures like vessels. Unfortunately, better suited
validation metrics for this certain purpose are not available yet.
Nevertheless, the evaluation revealed that the proposed
level-set segmentation technique leads to results comparable
to those achieved by human observers. The presented
segmentation method did not perform superior compared
to the other segmentation approaches tested in this work in
only one case. This one dataset exhibits a large apical located
arteriovenous malformation and many large dilated draining
veins, which lead to a suboptimal intensity non-uniformity
correction and also to an insufcient vessel enhancement.
Therefore, the intensity-based stochastic model segmentation, which does not rely on the vesselness image, performed
best in this case.
270
[7] Shapiro LB, Tien RD, Golding SJ, Totterman SM. Preliminary results of
a modified surface rendering technique in the display of magnetic
resonance angiography images. Magn Reson Imaging 1994;12(3):4618.
[8] Ries T, Wegscheider K, Wulff A, Radelfahr K, Sring D, Forkert ND,
et al. Quantification of recurrence volumes after endovascular
treatment of cerebral aneurysm as surrogate endpoint for treatment
stability. Neuroradiology 2011;53(8):5938.
[9] Brunenberg EJ, Vilanova A, Visser-Vandewalle V, Temel Y,
Ackermans L, Platel B, et al. Automatic trajectory planning for deep
brain stimulation: a feasibility study. Med Image Comput Comput
Assist Interv 2007;10(Pt 1):58492.
[10] Kirbas C, Quek F. A review of vessel extraction techniques and
algorithms. ACM Comput Surv 2004;36(2):81121.
[11] Al-Kwifi O, Emery DJ, Wilman AH. Vessel contrast at three Tesla in
time-of-flight magnetic resonance angiography of the intracranial and
carotid arteries. Magn Reson Imaging 2002;20(2):1817.
[12] Davis WL, Warnock SH, Harnsberger HR, Parker DL, Chen CX.
Intracranial MRA: single volume vs. multiple thin slab 3D time-offlight acquisition. J Comput Assist Tomogr 1993;17(1):1521.
[13] Chapman BE, Stapelton JO, Parker DL. Intracranial vessel segmentation from time-of-flight MRA using pre-processing of the MIP Zbuffer: accuracy of the ZBS algorithm. Med Image Anal 2004;8(2):
11326.
[14] Yi J, Ra JB. A locally adaptive region growing algorithm for vascular
segmentation. Int J Imaging Syst Technol 2003;13(4):20814.
[15] Dempster AP, Laird NM, Rubin DB. Maximum likelihood from
incomplete data via the EM algorithm. J R Stat Soc Ser B 1977;39(1):
138.
[16] Wilson DL, Noble JA. An adaptive segmentation algorithm for timeof-flight MRA data. IEEE Trans Med Imaging 1999;18(10):93845.
[17] Hassouna MS, Farag AA, Hushek S, Moriarty T. Cerebrovascular
segmentation from TOF using stochastic models. Med Image Anal
2006;10(1):218.
[18] Sato Y, Nakajima S, Shiraga N, Atsumi H, Yoshida S, Koller T, et al.
Three-dimensional multi-scale line filter for segmentation and
visualization of curvilinear structures in medical images. Med Image
Anal 1998;2(2):14368.
[19] Frangi AF, Niessen WJ, Vincken KL, Viergever MA. Multiscale vessel
enhancement filtering. Lect Notes Comput Sci 1998;1496:1307.
[20] Lorenz C, Carlsen IC, Buzug TM, Fassnacht C, Weese J. A multi-scale
line filter with automatic scale selection based on the Hessian matrix
for medical image segmentation. Lect Notes Comput Sci 1997;1252:
15263.
[21] Lesage D, Angelini ED, Bloch I, Funka-Lea G. A review of 3D vessel
lumen segmentation techniques: models, features and extraction
schemes. Med Image Anal 2009;13(6):81945.
[22] Lorigo LM, Faugeras OD, Grimson WE, Keriven R, Kikinis R, Nabavi
A, et al. CURVES: curve evolution for vessel segmentation. Med
Image Anal 2001;5(3):195206.
[23] Vasilevskiy A, Siddiqi K. Flux maximizing geometric flows. IEEE
Trans Pattern Anal Mach Intell 2002;24(12):156578.
[24] Gooya A, Liao H, Matsumiya K, Masamune K, Dohi T. Effective
statistical edge integration using a flux maximizing scheme for
volumetric vascular segmentation in MRA. Inf Process Med Imag
2007;20:8697.
[25] Suri JS, Liu K, Reden L, Laxminarayan S. A review on MR vascular
image processing: skeleton versus nonskeleton approaches: Part II.
IEEE Trans Inf Technol Biomed 2002;6(4):33850.
[26] Kholmovski EG, Alexander AL, Parker DL. Correction of slab
boundary artifact using histogram matching. J Magn Reson Imaging
2002;15(5):6107.
[27] Sled JG, Zijdenbos AP, Evans AC. A nonparametric method for
automatic correction of intensity nonuniformity in MRI data. IEEE
Trans Med Imaging 1998;17(1):8797.
[28] Forkert ND, Saring D, Fiehler J, Illies T, Moller D, Handels H.
Automatic brain segmentation in time-of-flight MRA images. Methods
Inf Med 2009;48(5):399407.
[36]
[37]
[38]
[39]
[40]
271