You are on page 1of 15

Design of Performance Monitoring Unit for Reconfigurable

Embedded Processor

Synop
sis
Submitted for Registration as a research student for the degree of
Master of Electronics (Communication) Engineering

By
Mr. Roshan Rakhunde

Under the guidance of


Prof. Tushar Uplanchiwar

Submitted to
Rashtrasant Tukadoji Maharaj Nagpur University, Nagpur
(Faculty of Engineering and Technology)
2016-2017

0
Title: Design Of Performance Monitoring Unit For Reconfigurable Embedded
Processor.

1
Introduction:

Satellite imaging for the observation of Earth has ability to obtain very high-resolution
data, ranged from 0.5 to 2 m in the panchromatic band. Indeed, high-resolution images

exhibit more detail information to increase the object-oriented application potential, e.g.,
a building accurate location, detailed feature extraction, and 3D reconstruction [1],
[2].Unfortunately, most high-resolution satellite images contain shadows as undesired
interpretation of satellite images. The shadows cause the partial or total loss radiance
information, particularly that of occluded objects by the large shadow. In that case, the
objects in the shadow regions are difficult to be extracted for further applications.

Therefore, in order to restore obscured objects, shadow detection and shadow removal is
an essential preprocessing step of urban high-resolution remote sensing images. Many
effective algorithms of shadow removal have been proposed for natural images or remote
sensing multispectral images. However, there is a great lack of shadow removal method
for panchromatic imagery, while the panchromatic images usually can provide more

high resolution to be useful for the application of objects in the satellite sensors. For the
purpose of the information recovery of obscured objects, we intend to analyze the
characteristics of shadows and objects in the panchromatic images of urban areas

and remove the shadows to obtain shadow-free images.

Many current researches indicate that shadow detection is the indispensable step in the
complete processing chain of shadow removal. Popular methods of shadow detection can
be focused on the shadow property, such as shadow regions having lower intensity, higher
hue, and saturation. For instance, shadow areas are determined by the threshold method
with bimodal distribution of image histogram . Moreover, a lot of literature works show
that the threshold detection results aremore accuracy using near-infrared band for the
multispectral images [4], [5]. Based on the bimodal thresholding method, several shadow
detection algorithms are proposed. Mohamed and Khan Iftekharuddin

2
[6] employs morphological filtering to rule out small wrong shadow regions, and carries
out re-segmentation with multilevel threshold to refine detected results. For the
panchromatic imagery, a few researches are done, which also employ the threshold
method to segment shadows as the main step . In all the mentioned methods above,
shadows are detected absolutely by a binary mask that cannot describe shadows
accurately, because of the complex scenes and the existence of penumbras in the high-
resolution satellite images of urban areas.

In this work, we propose a novel method to combine the threshold method and the image
matting method and to obtain the soft shadow detection results automatically. The
shadow removal is the core of this paper. In order to recover the information of shadow
areas, there are three major methods by image enhancement technique:

1) gamma correction, 2) histogram matching, and 3) linear correlation

In a related study, the methods are analyzed to obtain a smooth shadow-free image. In
[5], shadow areas are restored by a piecewise linear function correlation with different
ratio parameters according to different darkness levels.

In this work we expect to present three main contributions. First, we will build a novel
automatic shadow detection and removal framework for the high-resolution satellite
panchromatic images. Second, a bimodal histogram splitting method and image matting
technique will both be used to automatically obtain soft shadow detection results. Finally
and most importantly, due to the shadow removal by linear correction leading to be
noisier in the shadow areas, we propose the spatial adaptive nonlocal sparse (SANS)
method to combine the nonlocal sparse model and the second linear radiometric
correction to simultaneously control the brightness and smoothness of the recovered
shadow areas.

2) Brief Literature Survey :

3
Paper [1]:- A. Makarau, R. Richter, R. Muller, and P. Reinartz, Adaptive shadow
detection using a blackbody radiator model, IEEE Trans. Geosci. Remote Sens., vol. 49,
no. 6, pp. 20492059, Jun. 2011.
In this paper, an alternative robust method for shadow detection has been presented. The
method is based on the physical properties of a blackbody radiator. Instead of static methods,
this method adaptively calculates the parameters for a particular scene and allows one to
work with many different sensors and images obtained with different illumination conditions.
Experimental assessment illustrates significant improvement for shadow detection on typical
multispectral sensors in comparison to other shadow detection methods. Examples, as well as
quantitative assessment of the results, have been presented for Landsat-7 Enhanced Thematic
Mapper Plus, IKONOS, WorldView-2, and the German Aerospace Center (DLR) 3K Camera
airborne system.

Paper [2]:- V. J. D. Tsai, A comparative study on shadow compensation of color aerial


images in invariant color models, IEEE Trans. Geosci. Remote Sens., vol. 44, no. 6, pp.
16611671, Jun. 2006.
In this paper an automatic property-based approach for the detection and compensation of
shadow regions with shape information preserved in complex urban color aerial images for
solving problems caused by cast shadows in digital image mapping has been presented. The
technique has been applied in several invariant color spaces that decouple luminance and
chromaticity, including HSI, HSV, HCV, YIQ, and YC/sub b/C/sub r/ models. Experimental
results from de-shadowing color aerial images of a complex building and a highway segment
in these color models has been evaluated in terms of visual comparisons and shadow
detection accuracy assessments. The results show the effectiveness of the proposed approach
in revealing details under shadows and the suitability of these color models in de-shadowing
urban color aerial images.

Paper [3] :- L. Luca, F. Melgani, and G. Mercier, A complete processing chain for
shadow detection and reconstruction in VHR images, IEEE Trans. Geosci. Remote
Sens., vol. 50, no. 9, pp. 34403452, 2012.
In this paper the researchers have proposed a complete processing chain, which
relies on various advanced image processing and pattern recognition tools. The first key point

4
of the chain is that shadow areas are not only detected but also classified to allow their
customized compensation. The detection and classification tasks have been implemented by
means of the state-of-the-art support vector machine approach. A quality check mechanism
has been integrated in order to reduce subsequent misreconstruction problems. The
reconstruction is based on a linear regression method to compensate shadow regions by
adjusting the intensities of the shaded pixels according to the statistical characteristics of the
corresponding nonshadow regions. Moreover, borders are explicitly handled by making use
of adaptive morphological filters and linear interpolation for the prevention of possible
border artifacts in the reconstructed image. Experimental results obtained on three VHR
images representing different shadow conditions have been reported, discussed, and
compared with two other reconstruction techniques.

Paper [4]:- W. Liu and F. Yamazaki, Object-based shadow extraction and correction of
high-resolution optical satellite images, IEEE J. Sel. Topics Appl. Earth Observ. Remote
Sens., vol. 5, no. 4, pp. 12961302, Aug. 2012.

In this study, a radiance measurement was carried out to investigate the spectral
characteristics of sunlight. Then a method has been proposed for shadow detection and
correction of optical imagery. First, building shadow areas are detected using an object-based
classification method that employs brightness values and their relationship with the
neighboring area. Next, the detected shadow areas are corrected using a linear function to
produce a shadow-free image. The shadow pixels with different darkness levels have been
corrected by using different ratios to obtain a smoothly restored image. The proposed semi-
automated method was applied to a QuickBird and a WorldView-2 images of Tokyo, Japan,
to demonstrate the effectiveness of the method.

Paper [5]:- E.Mohamed and M. Khan Iftekharuddin, Shadowdetection ofman-made


buildings in high-resolution panchromatic satellite images, IEEE Trans. Geosci. Remote
Sens., vol. 52, no. 9, pp. 53745386, 2014.

5
In this paper, a new algorithm for shadow detection and isolation of buildings in high-
resolution panchromatic satellite imagery has been proposed . The proposed algorithm is
based on tailoring the traditional model of the geometric active contours such that the new
model of the contours is systematically biased toward segmenting the shadow and the dark
regions in the image. The systematic biasing in the proposed contour model has been
accomplished by novel encoding of the radiometric characteristics of the shadows regions.
After detecting and segmenting the shadow and the dark regions in the image, further
processing steps are introduced. The proposed post processing is based on selection of
optimal threshold and a boundary complexity metric to distinguish the true shadows from the
clutter. Experimental results have been presented to validate the performance of the proposed
algorithm on real high-resolution panchromatic satellite images.

6
3) Problem Formulation
The proposed framework involves the two main procedures as shown in Fig. 1: shadow
detection and shadow removal.

1) -Detection:
In the detection step, we present an automatic soft shadow detection method by bimodal
histogram splitting and image matting technique.

The detection mainly contains three steps.


1) The shadow image is classified to shadow and non shadow areas roughly by hard
threshold. The hard map of binary mask cannot provide the precise edges
between the two areas, due to the presence of penumbra.

7
2) The shadow areas are eroded and dilated by morphological operators and the
difference middle areas are filled with the original image.
3) we employ the image matting method to calculate the shadow coefficient for each
pixel based on the mask image. 0 is shadow, 1 is non shadow, and the penumbra
area is from 0 to 1 to indicate the shadow probability.

2) Removal
In the removal step, we propose a SANS shadow removal method.
Our removal method will be divided into two levels: the initial removal and the refined
removal. In the initial removal level, the line correction method will be employed to
enhance the shadow area. The initial result is aimed to make the same object across
shadow and non shadow areas belong roughly to the same category.

In the refined process, we will analyze the spatial relationship between objects and
shadows, and dig into their characteristics. The obscured information of objects in the
shadow areas is recovered precisely by the unit of patches based on the group matrix.
Each group consists of nonlocal patches with similar structure from shadow areas and
nonshadow areas.
The second linear radiometric correction and nonlocal sparse model will be used to
simultaneously control the brightness and smoothness of the recovered areas by the
corresponding nonshadow areas with similar structure in the same group matrix.
Therefore, our SANS removal method will be able to obtain the recovered objects across
shadow and nonshadow areas to be the same image quality.

8
4) Objectives

The basic objective in this work is as below


1) To present an automatic soft shadow detection method and a SANS shadow
removal method for the very high resolution panchromatic satellite images.
2) To deal with the challenging problem of the shadow removal in the panchromatic
images, particularly to recover the obscured information of objects precisely.

For shadow detection, we will combine the bimodal histogram splitting method and
image matting technique to obtain the soft detection results automatically. The soft
shadow detection
results will show the probability value of each pixel belonging to the shadow, to solve the
presence of penumbras.
For shadow removal to restore the occluded information of objects, we have proposed
two levels removal method concluding the initial correction and the refined restoration.
The initial correction step will compensate the intensity for shadow areas by global
parameter. In the refined restoration step, we will utilize group sparse representation to
build the relationship between the shadow area and the corresponding nonshadow area of
the same objects.
Shadow areas will be restored precisely using nonshadow patches with similar structure
in the same group, what is more, making the obscured part of objects be the same
brightness and
smoothness level as the other part in the nonshadow area. The uniform shadow-free
images will be obtained by the proposed method.

Our objective can be summarized as follows:


1) The soft shadow detection will be performed. The shadow probability will be
calculated accurately to show the distribution of umbra and penumbra. The proposed
automatic method is expected to be effective to avoid the boundary effects after recovery,
due to the presence of the penumbra.

9
2) The proposed SANS shadow removal method is expected to restore the obscured
information of objects in shadow areas effectively.
We will analyze two cases of the spatial relationship between the objects and shadows.
The shadow areas will be restored by similar structure patches based on the group sparse
representation, and the smooth results are expected to be obtained .
3) Based on group matrix of our SANS method, we will try to present a twice line
correction method to control the brightness of the recovered areas. First correction will
use the whole image
parameters to enhance shadow areas roughly. Second correction will use the parameters
of similar patches in the group matrix to correct each patch in shadow areas, and uniform
shadow-free images will be obtained .

10
5) Research Methodology/Planning of Work:
The proposed work is planned to be carried out in the following manner
1. Modeling
2. Simulation
3. Analysis

11
6) Facilities required for proposed work:
i) Hardware

Pentium-IV.
Monitor.
Keyboard.
Mouse.
160 GB HDD
1GB RAM

ii) Software
Windows XP/7.
Modeling & Simulation : MATLAB 10

12
7) Plan of Research:Research Planning

July- Aug- Sept- Oct- Nov- Dec- Jan- Feb- Mar- Apr- May-
15 15 15 15 15 15 16 16 16 16 16

Duration in Months

Literature Survey Verification of


Proposed modules
Analysis & Detailed Study Intermediate Result
& Final Result
Analysis
Implementation Thesis Writing &
Submission
Paper Publications

13
Bibliography:

1] A. Makarau, R. Richter, R. Muller, and P. Reinartz, Adaptive shadow detection using


a blackbody radiator model, IEEE Trans. Geosci. Remote Sens., vol. 49, no. 6, pp. 2049
2059, Jun. 2011.

[2] V. J. D. Tsai, A comparative study on shadow compensation of color aerial images in


invariant color models, IEEE Trans. Geosci. Remote Sens., vol. 44, no. 6, pp. 1661
1671, Jun. 2006.

[3] L. Luca, F. Melgani, and G. Mercier, A complete processing chain for shadow
detection and reconstruction in VHR images, IEEE Trans. Geosci. Remote Sens., vol.
50, no. 9, pp. 34403452, 2012.

[4] W. Liu and F. Yamazaki, Object-based shadow extraction and correction of high-
resolution optical satellite images, IEEE J. Sel. Topics Appl. Earth Observ. Remote
Sens., vol. 5, no. 4, pp. 12961302, Aug. 2012.

[5] E.Mohamed and M. Khan Iftekharuddin, Shadowdetection ofman-made buildings in


high-resolution panchromatic satellite images, IEEE Trans. Geosci. Remote Sens., vol.
52, no. 9, pp. 53745386, 2014.

Mr.Roshan Rakhunde Prof. Tushar Uplanchiwar


Research Student Guide
Prof. Rohini Pochhi
Head of Electronics and Communication Engineering
Tulsiramji Gaikwad-Patil College of Engineering & Technology, Nagpur
2016-2017

14

You might also like