An approach for improving the performance of the Content-Based Image Retrieval (CBIR)

정인성 한국측량학회 2012 한국측량학회지 Vol.30 No.6

Amid rapidly increasing imagery inputs and their volume in a remote sensing imagery database, Content-Based Image Retrieval (CBIR) is an effective tool to search for an image feature or image content of interest a user wants to retrieve. It seeks to capture salient features from a ‘query’ image, and then to locate other instances of image region having similar features elsewhere in the image database. For a CBIR approach that uses texture as a primary feature primitive, designing a texture descriptor to better represent image contents is a key to improve CBIR results. For this purpose, an extended feature vector combining the Gabor filter and co-occurrence histogram method is suggested and evaluated for quantitywise and qualitywise retrieval performance criterion. For the better CBIR performance, assessing similarity between high dimensional feature vectors is also a challenging issue. Therefore a number of distance metrics (i.e. L1 and L2 norm) is tried to measure closeness between two feature vectors, and its impact on retrieval result is analyzed. In this paper,experimental results are presented with several CBIR samples. The current results show that 1) the overall retrieval quantity and quality is improved by combining two types of feature vectors, 2) some feature is better retrieved by a specific feature vector, and 3) retrieval result quality (i.e. ranking of retrieved image tiles) is sensitive to an adopted similarity metric when the extended feature vector is employed.

내용기반 검색 기법을 이용한 인터넷 기반 유방종양 조직병리영상 검색 시스템 개발

김민경,황해길,최흥국,최현주 대한의료정보학회 2005 Healthcare Informatics Research Vol.11 No.1

Objective: We have developed breast tumor image retrieval system using content-based retrieval method. It compares the breast tumor image with Fibrocystic Change images, Ductal Carcinoma in Situ images and Invasive Ductal Carcinoma images and find most similar one. Since the final diagnosis for breast tumor image is done only by pathologist manually, this system can provide the objectivity and the reproducibility for determining and diagnosing the breast tumor. Methods: The breast tumor image features used in the content-based image retrieval are color feature, texture feature and texture features of wavelet transformed images. And the system can be accessed through the internet. We used Windows 2003 as an operating system, Internet Information Server 6.0 as Web a server and ms-sql server 2000 as a database server. Also we use ActiveX Data Object to connect database easily. Result: We evaluated the recall and precision performance of the system according to the combinations of feature types and usage of partial or whole image. Results showed that the use of multiple features and whole image gave consistently higher rates compared to the use of single feature and partial image. Conclusion: This retrieval system can help pathologist determine the type of breast tumor more efficiently. Also it is working based on the internet, we can use it for researching and teaching in pathology later.

Content-Based Image Retrieval Using Combined Color and Texture Features Extracted by Multi-resolution Multi-direction Filtering

부희형,김남철,문채주,김종화 한국정보처리학회 2017 Journal of information processing systems Vol.13 No.3

In this paper, we present a new texture image retrieval method which combines color and texture features extracted from images by a set of multi-resolution multi-direction (MRMD) filters. The MRMD filter set chosen is simple and can be separable to low and high frequency information, and provides efficient multiresolution and multi-direction analysis. The color space used is HSV color space separable to hue, saturation, and value components, which are easily analyzed as showing characteristics similar to the human visual system. This experiment is conducted by comparing precision vs. recall of retrieval and feature vector dimensions. Images for experiments include Corel DB and VisTex DB; Corel_MR DB and VisTex_MR DB, which are transformed from the aforementioned two DBs to have multi-resolution images; and Corel_MD DB and VisTex_MD DB, transformed from the two DBs to have multi-direction images. According to the experimental results, the proposed method improves upon the existing methods in aspects of precision and recall of retrieval, and also reduces feature vector dimensions.

Content-Based Image Retrieval Using Combined Color and Texture Features Extracted by Multi-resolution Multi-direction Filtering

Bu, Hee-Hyung,Kim, Nam-Chul,Moon, Chae-Joo,Kim, Jong-Hwa Korea Information Processing Society 2017 Journal of information processing systems Vol.13 No.3

In this paper, we present a new texture image retrieval method which combines color and texture features extracted from images by a set of multi-resolution multi-direction (MRMD) filters. The MRMD filter set chosen is simple and can be separable to low and high frequency information, and provides efficient multi-resolution and multi-direction analysis. The color space used is HSV color space separable to hue, saturation, and value components, which are easily analyzed as showing characteristics similar to the human visual system. This experiment is conducted by comparing precision vs. recall of retrieval and feature vector dimensions. Images for experiments include Corel DB and VisTex DB; Corel_MR DB and VisTex_MR DB, which are transformed from the aforementioned two DBs to have multi-resolution images; and Corel_MD DB and VisTex_MD DB, transformed from the two DBs to have multi-direction images. According to the experimental results, the proposed method improves upon the existing methods in aspects of precision and recall of retrieval, and also reduces feature vector dimensions.

Content-based Image Retrieval Using Texture Features Extracted from Local Energy and Local Correlation of Gabor Transformed Images

Bu, Hee-Hyung,Kim, Nam-Chul,Lee, Bae-Ho,Kim, Sung-Ho Korea Information Processing Society 2017 Journal of information processing systems Vol.13 No.5

In this paper, a texture feature extraction method using local energy and local correlation of Gabor transformed images is proposed and applied to an image retrieval system. The Gabor wavelet is known to be similar to the response of the human visual system. The outputs of the Gabor transformation are robust to variants of object size and illumination. Due to such advantages, it has been actively studied in various fields such as image retrieval, classification, analysis, etc. In this paper, in order to fully exploit the superior aspects of Gabor wavelet, local energy and local correlation features are extracted from Gabor transformed images and then applied to an image retrieval system. Some experiments are conducted to compare the performance of the proposed method with those of the conventional Gabor method and the popular rotation-invariant uniform local binary pattern (RULBP) method in terms of precision vs recall. The Mahalanobis distance is used to measure the similarity between a query image and a database (DB) image. Experimental results for Corel DB and VisTex DB show that the proposed method is superior to the conventional Gabor method. The proposed method also yields precision and recall 6.58% and 3.66% higher on average in Corel DB, respectively, and 4.87% and 3.37% higher on average in VisTex DB, respectively, than the popular RULBP method.

Texture Descriptor for Texture-Based Image Retrieval and Its Application in Computer-Aided Diagnosis System

뮤잠멜(Khairul Muzzammil Saipullah),팽소호(Shao-Hu Peng),김덕환(Deok-Hwan Kim) 대한전자공학회 2010 電子工學會論文誌-CI (Computer and Information) Vol.47 No.4

질감 정보는 객체 인식과 분류에서 중요한 역할을 하고 있다. 정확한 질환 판별을 위해 분류에서 사용되는 질감 특징은 식별성이 높아야 한다. 본 논문에서는 질감-기반 영상 검색 및 폐기종 진단을 위해 컴퓨터 조력진단(Computer-Aided Diagnosis) 시스템을 위한 새로운 질감 기술자를 제안한다. 제안한 질감 기술자는 이웃화소간의 차이값과 중심화소와 이웃화소간의 차이 값의 결합에 기반을 두고 있어 결합된 주변화소 차이(Combined Neighborhood Difference CND)라고 한다. 화소들간의 CND는 비교후 이진 코드워드로 변환된다. 그다음에, 식별성이 높은 값을 생성하기 위하여 이진 계수가 코드워드에 할당된다. 이와 같은 값들의 분포가 계산되어 질감 특징 벡터를 구성한다. Outex와 Brodatz 데이터집합을 이용한 질감 특징 분류에 관련하여 CND는 92.5%의 정확성을 보이는 데 비해, LBP, LND와 Gabor 픽터는 89.3%, 90.7%와 83.6%의 정확성을 각각 보여준다. 본 논문에서는 CND를 이용한 폐기종의 진단 기능을 CAD 시스템에서 구현하였다. Texture information plays an important role in object recognition and classification. To perform an accurate classification, the texture feature used in the classification must be highly discriminative. This paper presents a novel texture descriptor for texture-based image retrieval and its application in Computer-Aided Diagnosis (CAD) system for Emphysema classification. The texture descriptor is based on the combination of local surrounding neighborhood difference and centralized neighborhood difference and is named as Combined Neighborhood Difference (CND). The local differences of surrounding neighborhood difference and centralized neighborhood difference between pixels are compared and converted into binary codewords. Then binomial factor is assigned to the codewords in order to convert them into high discriminative unique values. The distribution of these unique values is computed and used as the texture feature vectors. The texture classification accuracies using Outex and Brodatz dataset show that CND achieves an average of 92.5%, whereas LBP, LND and Gabor filter achieve 89.3%, 90.7% and 83.6%, respectively. The implementations of CND in the computer-aided diagnosis of Emphysema is also presented in this paper.

Content-based Image Retrieval Using Texture Features Extracted from Local Energy and Local Correlation of Gabor Transformed Images

( Hee-hyung Bu ),( Nam-chul Kim ),( Bae-ho Lee ),( Sung-ho Kim ) 한국정보처리학회 2017 Journal of information processing systems Vol.13 No.5

In this paper, a texture feature extraction method using local energy and local correlation of Gabor transformed images is proposed and applied to an image retrieval system. The Gabor wavelet is known to be similar to the response of the human visual system. The outputs of the Gabor transformation are robust to variants of object size and illumination. Due to such advantages, it has been actively studied in various fields such as image retrieval, classification, analysis, etc. In this paper, in order to fully exploit the superior aspects of Gabor wavelet, local energy and local correlation features are extracted from Gabor transformed images and then applied to an image retrieval system. Some experiments are conducted to compare the performance of the proposed method with those of the conventional Gabor method and the popular rotation-invariant uniform local binary pattern (RULBP) method in terms of precision vs recall. The Mahalanobis distance is used to measure the similarity between a query image and a database (DB) image. Experimental results for Corel DB and VisTex DB show that the proposed method is superior to the conventional Gabor method. The proposed method also yields precision and recall 6.58% and 3.66% higher on average in Corel DB, respectively, and 4.87% and 3.37% higher on average in VisTex DB, respectively, than the popular RULBP method.

모바일 디바이스상에서 공간-칼라와 가버 질감을 이용한 내용-기반 영상 검색

이용환,이준환,조한진,권오진,김영섭 한국반도체디스플레이기술학회 2014 반도체디스플레이기술학회지 Vol.13 No.4

Mobile image retrieval is one of the most exciting and fastest growing research fields in the area of multimedia technology. As the amount of digital contents continues to grow users are experiencing increasing difficulty in finding specific images in their image libraries. This paper proposes a new efficient and effective mobile image retrieval method that applies a weighted combination of color and texture utilizing spatial-color and second order statistics. The system for mobile image searches runs in real-time on an iPhone and can easily be used to find a specific image. To evaluate the performance of the new method, we assessed the iPhone simulations performance in terms of average precision and recall using several image databases and compare the results with those obtained using existing methods. Experimental trials revealed that the proposed descriptor exhibited a significant improvement of over 13% in retrieval effectiveness, compared to the best of the other descriptors.

Content-Based Image Retrieval Using Combined Color and Texture Features Extracted by Multi-resolution Multi-direction Filtering

( Hee-hyung Bu ),( Nam-chul Kim ),( Chae-joo Moon ),( Jong-hwa Kim ) 한국정보처리학회 2017 Journal of information processing systems Vol.13 No.3

In this paper, we present a new texture image retrieval method which combines color and texture features extracted from images by a set of multi-resolution multi-direction (MRMD) filters. The MRMD filter set chosen is simple and can be separable to low and high frequency information, and provides efficient multi-resolution and multi-direction analysis. The color space used is HSV color space separable to hue, saturation, and value components, which are easily analyzed as showing characteristics similar to the human visual system. This experiment is conducted by comparing precision vs. recall of retrieval and feature vector dimensions. Images for experiments include Corel DB and VisTex DB; Corel_MR DB and VisTex_MR DB, which are transformed from the aforementioned two DBs to have multi-resolution images; and Corel_MD DB and VisTex_MD DB, transformed from the two DBs to have multi-direction images. According to the experimental results, the proposed method improves upon the existing methods in aspects of precision and recall of retrieval, and also reduces feature vector dimensions.

JPEG-2000 부분 엔트로피 복호화에 의향 질감 영상 데이터베이스 검색

박하중,정호열,Park, Ha-Joong,Jung, Ho-Youl 한국통신학회 2007 韓國通信學會論文誌 Vol.32 No.5c

본 논문에서는 엔트로피 복호화 과정을 부분적으로 수행하여 특징 벡터를 구성하는 새로운 JPEG-2000 압축 영상 검색 시스템을 제안한다. 제안하는 방법은 JPEG-2000 엔트로피 부호화 과정을 통해 발생하는 다양한 문맥 정보를 이용한다. 엔트로피 부호화 기술은 주위 인접한 웨이블릿 계수들의 부호 및 중요 상태 계수의 구조적인 패턴을 분석하여 세 가지의 부호화 패스 및 네 가지의 부호화 기술을 통해 총 19가지의 문맥 정보를 발생한다. 문맥 정보는 산술 부호화 과정에서 부호화 하는 심벌의 확률을 예측하기 위한 모델을 제공한다. 그리고 문맥 정보는 영상의 국부적인 특징을 서술 할 수 있기 때문에 다양한 패턴 특성을 나타내는 질감 영상을 효율적으로 정의할 수 있다. 또한 제안하는 알고리즘은 JPEG-2000 압축 영상에서 복호화 과정을 부분적으로 수행하기 때문에 영상 검색을 수행하기 위한 검색 시간에서 뛰어난 성능을 나타낼 수 있다. 실험을 위해 MIT VisTex 질감 영상을 이용하여 다양한 왜곡 영상 및 유사 영상 데이터베이스를 구성하였으며 기존 검색 알고리즘을 구현하여 제안하는 검색 시스템과 비교 및 평가한다. 본 논문에서 제안하는 알고리즘이 기존 검색 방법보다 검색 성능에서 뛰어날 뿐만 아니라 검색 시간에서도 많은 이득을 얻을 수 있다. In this paper, we propose a novel JPEG-2000 compressed image retrieval system using feature vector extracted through partial entropy decoding. Main idea of the proposed method is to utilize the context information that is generated during entropy encoding/decoding. In the framework of JPEG-2000, the context of a current coefficient is determined depending on the pattern of the significance and/or the sign of its neighbors in three bit-plane coding passes and four coding modes. The contexts provide a model for estimating the probability of each symbol to be coded. And they can efficiently describe texture images which have different pattern because they represent the local property of images. In addition, our system can directly search the images in the JPEG-2000 compressed domain without full decompression. Therefore, our proposed scheme can accelerate the work of retrieving images. We create various distortion and similarity image databases using MIT VisTex texture images for simulation. we evaluate the proposed algorithm comparing with the previous ones. Through simulations, we demonstrate that our method achieves good performance in terms of the retrieval accuracy as well as the computational complexity.