Научная статья на тему 'A novel approach for partial shape matching and similarity based on data envelopment analysis'

A novel approach for partial shape matching and similarity based on data envelopment analysis Текст научной статьи по специальности «Компьютерные и информационные науки»

CC BY
183
66
i Надоели баннеры? Вы всегда можете отключить рекламу.
Ключевые слова
partial shape matching / shape retrieval / 3D descriptor / indexation.

Аннотация научной статьи по компьютерным и информационным наукам, автор научной работы — Khadija Arhid, Fatima Rafii Zakani, Basma Sirbal, Mohcine Bouksim, Mohamed Aboulfatah

Due to the growing number of 3D objects in digital libraries, the task of searching and browsing models in an extensive 3D database has been the focus of considerable research in the area. In the last decade, several approaches to retrieve 3D models based on shape similarity have been proposed. The majority of the existing methods addresses the problem of similarity between objects as a global matching problem. Consequently, most of these techniques do not support a part of the object as a query, in addition to their poor performance for classes with globally non-similar shape models and also for articulated objects. The partial matching technique seems to be a suitable solution to these problems. In this paper, we address the problem of shape matching and retrieval. We propose a new approach based on partial matching in which each 3D object is segmented into its constituent parts, and shape descriptors are computed from these elements to compare similarities. Several experiments investigated that our technique enables fast computing for content-based 3D shape retrieval and significantly improves the results of our method based on Data Envelopment Analysis descriptor for global matching.

i Надоели баннеры? Вы всегда можете отключить рекламу.
iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.
i Надоели баннеры? Вы всегда можете отключить рекламу.

Текст научной работы на тему «A novel approach for partial shape matching and similarity based on data envelopment analysis»

A novel approach for partial shape matching and similarity based on data envelopment analysis

K. Arhid1, F.R. Zakani1, M. Bouksim 1, B. Sirbal1, M. Aboulfatah 2, T. Gadi1 1 Laboratory of Informatics, Imaging, and Modeling of Complex Systems (LIIMSC) Faculty of Sciences and Techniques,

Hassan 1st University, Settat, Morocco;

2 Laboratory of Analysis of Systems and Treatment of Information (LASTI) Faculty of Sciences and Techniques,

Hassan 1st University, Settat, Morocco

Abstract

Due to the growing number of 3D objects in digital libraries, the task of searching and browsing models in an extensive 3D database has been the focus of considerable research in the area. In the last decade, several approaches to retrieve 3D models based on shape similarity have been proposed. The majority of the existing methods addresses the problem of similarity between objects as a global matching problem. Consequently, most of these techniques do not support a part of the object as a query, in addition to their poor performance for classes with globally non-similar shape models and also for articulated objects. The partial matching technique seems to be a suitable solution to these problems. In this paper, we address the problem of shape matching and retrieval. We propose a new approach based on partial matching in which each 3D object is segmented into its constituent parts, and shape descriptors are computed from these elements to compare similarities. Several experiments investigated that our technique enables fast computing for content-based 3D shape retrieval and significantly improves the results of our method based on Data Envelopment Analysis descriptor for global matching.

Keywords: partial shape matching, shape retrieval, 3D descriptor, indexation.

Citation: Arhid K, Zakani FR, Bouksim M, Sirbal B, Aboulfatah M, Gadi T. A novel approach for partial shape matching and similarity based on data envelopment analysis. Computer Optics 2019; 43(2): 316-323. DOI: 10.18287/2412-6179-2019-43-2-316-323.

Acknowledgments: We would like to thank Michael Kazhdan, Papadakis Panagiotis, and Chen Ding-Yun for providing the executable code for their methods respectively the Spherical Harmonic, PANORAMA, and LightField. We would also like to thank George Ioannakis et al. [1] for their online platform (http://retrieval.ceti.gr/) that help us to evaluate our proposed approach.

Introduction

In last years, a considerable number of 3D models is growing in digital form on the World Wide Web, and this amount intends to increase in the future. As databases are in continuous expansion, indexing 3D models for comparing can be a complicated task, requiring considerable amounts of algorithms and tools to retrieve information. Thus, several techniques of 3D shape analysis and matching have been developed; among them shape similarity, indexation, shape retrieval, mesh segmentation, and many others. Computing the similarity between 3D shapes is a critical problem and a challenging task in computer vision, computer graphics, and a variety of other fields. The content-based approach has already attracted significant attention as a new accurate technique in various research areas.

The main idea of similarity search techniques for 3D-models is to find a suitable descriptor that can be extracted and compared quickly, and having a high discriminative power in distinguishing between similar and dissimilar 3D-models. The content-based retrieval process is done with offline and online steps, which are indexing, querying, matching and visualizing. Except for the first step that is processed offline, the rest three stages are performed online. We can distinguish two types of 3D indexation methods; the global ones that aim to compute a signature for the entire object and the partial methods which consist on matching subparts or regions by calculating the signature of each part of the object and require

a segmentation preprocessing step. The literature provides a large number of signatures based on geometric and semantic criteria of the 3D-model, these works [2,3] present extensive surveys of the existing methods in the literature. Despite the variety of research toward indexation, most existing methods for shape analysis are based on global shape similarity functions. However, only a very few methods can handle efficiently 3D partial shape retrieval because it is much more difficult than the global similarity search problem, since it has to search and define the subparts before measuring similarities.

In this article, we propose to use a similarity search technique that compares the similarity between portions of 3D models rather than a global comparison. Using our approach, each 3D model is divided into its meaningful parts using significant segmentation methods presented recently in the literature, after segmenting the 3D objects we calculate for each part its descriptor by the method based on multi-criteria using DEA [4]. Two models are considered as similar if their segments are similar. Using this partial similarity, we can perform a similarity search not only with the 3D models in their entirety but also with their different portions which are useful to find a model having parts that are close to parts of another model.

The present paper is organized as follows: In section 1, we review a brief state-of-the-art of the existing descriptors in the literature. In section 2, we describe our proposed approach. The experimental results are dis-

cussed in section 3. Finally, in the last section, we present a conclusion and some perspectives.

1. Related works

During the last decade, several approaches to retrieve 3D models based on shape similarity have been proposed [2, 3]. Some of these content-based retrieval systems are based on 2D views for indexing 3D objects, the main idea of these techniques is to capture for each 3D object a set of 2D views, then, and a 3D model is represented by 2D shape descriptors associated to these pictures. Other approaches aim to calculate for each 3D model a global shape descriptor by capturing intrinsic characteristics of the object in its entire form. On the contrary of the partial 3D / 3D indexing approaches that consist of decomposing the 3D object into different parts and then the 3D model is characterized by the set of signatures computed for their constituent segments. For more details, readers are invited to refer to [3, 5, 8] which offers an extensive study and an experimental comparison of many of the existing methods in the literature. In this section, we present briefly an overview of the indexing methods proposed in the literature for each category.

View-based approaches

The principal idea of these methods is to capture for each 3D model a set of images taken by cameras distributed around the model from different angles. Then, a 3D model is described by 2D shape descriptors associated to these views, and the similarity is measured using 2D shape matching techniques. These approaches require a normalization step to overcome the problem of invariance at translation, rotation and scaling. The primary challenge of these methods is the selection of the characteristic pictures of the 3D object. The results of these types of techniques depend mainly on the choice of the characteristic views, a large number correctly represent the 3D model but it will generate a set of large descriptors, and therefore the retrieval process requires more running time, and vice versa. Several methods of indexing 3D objects by 2D views have been proposed in the literature. These approaches differentiate according to the number and position of views, the 2D shape descriptor used, and the way in which similarity is calculated between views. We can mention the work of [9] in which the authors propose a descriptor based on 2D views called Light Field Descriptor. First, a normalization step under translation and scaling is applied. Then 10 different silhouettes are extracted for each 3D model and both 35 coefficients for the Zernike moments descriptor, and 10 coefficients for the Fourier descriptor are used to characterize each silhouette. The authors in [10] included an approach for 3D mesh retrieval in which a set of 42 depth images is captured from different viewpoints, and then each capture is characterized using the 2D generic Fourier-descriptor. Finally, the distance between two models is deduced by computed all possible combinations of the two sets of descriptors. Papadakis et al. [11] proposed a descriptor based on a set of panoramic views of a 3D object, which describe the position, and orientation of the model's sur-

face in 3D space. For each projection, the authors compute its corresponding 2D Discrete Fourier Transform and employ local relevance feedback (LRF) as a matching technique.

Global shape-based approaches

Global shape-based approaches use global geometric or topological characteristics of the object in its entire form to process 3D models matching. Osada et al. [12] included five Shape distributions based on global geometric characteristics of the object such as distance, angle, area and volume. D2 and A3 are the most used which represent respectively the distribution computed as the distance between two random points on the surface and the distribution function that calculates the angle formed by three random points on the surface of the object. Zaharia et al. [13] introduced a descriptor called Shape Spectrum Descriptor (SSD). The proposed descriptor defined as the distribution of the shape index [14] over the entire mesh. The authors in [15] proposed a Density-based 3D shape descriptor defined as a sampled probability density function. This function is based on three types of local geometric multidimensional features of a point on the surface of the 3D object. The 3D Harmonics descriptor proposed by Funkhouser et al. [16] based on spherical harmonics to compute the similarity between objects. The authors firstly decompose the 3D model into a collection of functions defined on concentric spheres. Then, they use the spherical harmonics to discard orientation information. Our recent work has presented a new descriptor for 3D content-based shape retrieval [4]. The proposed approach was based on Data Envelopment Analysis (DEA) [17] to combine multiple geometric and topologic criteria of the 3D object for a global matching. The chosen measures are the dihedral angle, the shape index, and the Shape Diameter function. In the same context, recently, our research team [18] introduced a new technique for retrieving and classifying 3D objects. This method is based on artificial neural network, which learns from several criteria that present information representative of the 3D mesh to extract a final descriptor.

Partial shape-based approaches

The partial indexing approaches consist of decomposing the 3D object into its constituent parts and then the 3D model is indexed by the set of signatures computed for their segments. Despite the advantages that partial descriptors can provide, few content-based approaches support partial matching. Suzuki et al. [19] proposed an approach for partial matching using the information of the entire object. The authors firstly apply a simple decomposition technique by comparing angles created by normal vectors of each polygonal face to find sharp angles and cuts polygonal faces into parts based on a typical clustering approach. Then each part is initially normalized for scale and orientation by using principal component analysis pose normalization. Finally, the authors compute the descriptors for these segments and use a matching technique identical to the techniques used in typical 3D shape retrieval. Biasotti et al. [20] introduced an approach for

partial shape matching based on the theory of Reeb graphs. They propose to encode the shape and all its constituent parts in a graph, which represents the structure of the object and its geometry. The graph-matching technique is used for sub-part correspondence. Chahhou et al. [21] proposed a hybrid approach for 3D object retrieval using a global-partial technique by combining the partial signatures of the segments of a 3D object and its global descriptor. Firstly, the authors decompose the 3D object into its constituent regions, and then they compute the D2 descriptor [12] for each part and use the shape spectrum descriptor [13] to provide global description of the shape of the objects. In this paper, we propose a new approach based on partial matching technique in which each 3D object is segmented into its different segments, and shape descriptors are computed from these elements to compare similarities. We also propose a new technique for calculating the similarity between the parts' descriptors.

2. Our proposed approach

In the last years, as a result of the extensive availability of 3D models, Content-based retrieval of 3D models has been considered as one of the major challenge in the research area. Until now, almost all the proposed approaches in the literature have been focused on global matching, where similarity is computed between entire models. In general, global 3D descriptors do not support a part of the object as a query, and they are poorly efficient for classes with globally non-similar shape models and also for articulated objects. The partial matching technique seems to be a suitable solution to these problems. The aim of this work is to introduce a new partial technique to resolve the problems encountered cited before using the global descriptor.

The global descriptor for 3D mesh retrieval using data envelopment analysis

Our recent work has presented a new descriptor for 3D content-based shape retrieval [4]. The proposed approach was based on Data Envelopment Analysis (DEA) [17] to combine multiple geometric and topologic criteria of the 3D object for a global matching. The chosen measures are the dihedral angle, the shape index and the Shape Diameter function. The dihedral angle represents a differential geometric property widely used in the 3D fields. While the shape index [14] is a measure describing the topology of the local surface using the principal curvatures. Finally, the Shape Diameter function is a scalar function representing the volume or thickness of a 3D mesh [22]. These three characteristics are invariant under scaling, translation, and rotation. The main idea of this work is to merge these metrics using an optimization function to extract a final descriptor combining the advantages of each combined measures. To this end, we choose to use Data Envelopment Analysis (DEA) [17] that represent a linear programming based technique for measuring the relative performance multiple inputs and/or outputs. This method gives a significant performance in matching similar objects, and the resulted descriptor is invariant under scaling, translation, and rotation and

does not need any pretreatment of normalization. For this reason, we opt to use this descriptor in our partial matching technique.

New partial technique _ for models matching

Partial matching is the task of matching subparts or regions. In this paper, we describe a new technique based on partial matching in which each 3D object is segmented into its constituent parts. Then, shape descriptors are computed from these elements to compare similarities. It is clear that the most critical challenge in this type of approach is how to segment a 3D object into meaningful parts. To determine which segmentation method we will use, we have evaluated different segmentation algorithms by using some of the recent evaluation methods proposed in the literature, which give an efficient quantitative evaluation by comparing the automatic segmentation with a set of ground truth segmentations instead of one to one comparison, these evaluation methods are: NWLD [23], WKD [24], WDC [25], WOI [26], WSSD [27], Dj3D [28] and the AEI [29]. Table 1 present for each segmentation method its average of the dissimilarity scores obtained for the entire database by using the cited evaluation methods. As can be deduced from this quantitative comparison, the dissimilarity scores of the learning-based algorithm (LB) [30] obtained by almost all the used evaluation methods are better than all the other methods, which highlight its performance.

Table 1. The obtained results using different evaluation metrics

Metrics / Algorithms WDC WKD NWLD WOI WSSD Dj3D AEI

LB [30] 0.16 0.11 0.18 0.18 0.28 0.13 0.22

RC [31] 0.21 0.17 0.28 0.23 0.38 0.21 0.29

NC [31] 0.27 0.18 0.31 0.25 0.40 0.26 0.43

FP [32] 0.27 0.23 0.34 0.25 0.54 0.28 0.56

KM[33] 0.30 0.25 0.39 0.28 0.41 0.31 0.64

SC [34] 0.22 0.19 0.24 0.22 0.39 0.22 0.30

After evaluating a set of segmentation methods by applying some of the most recent and efficient evaluation methods, we will continue by studying the behavior and the impact of the segmentation algorithms in the context of content-based research. To this end, we have applied our partial matching method using different segmentation algorithms, we calculate the recall-precision graph of each object in the database considered as a query, and then the recall-precision graph for the entire database is derived from the average of the curves obtained for each model. This process is repeated for each segmentation algorithm. The Fig. 1 shows the obtained results. As can be seen from the obtained results, the curve obtained using learning-based approach (LB) [30] gives once again a very good classification performance by being classified at the top of the automatic segmentation algorithms, followed by the Randomized Cut algorithm (RC) [31] which slightly superforms the approach based on spectral clustering (SC) [34]. In addition, the learning-based ap-

proach(LB) [30] offers a gain in operating time compared to the Randomized Cuts algorithm (RC) [31], which is costly in terms of response time of the different random segmentations it based.

Precision 1,0

1,0 Recall

Fig. 1. Precision-recall graph using our proposed approach with different segmentation algorithms

From all these results, we can easily deduce that the learning based method (LB) [30] is the better choice to be used in the partial indexation partial from all the tested segmentation methods. The Fig. 2 illustrates an example of segmentation obtained using this approach.

Fig. 2. An example of segmentation obtained using learning based method (LB) [30]

The Fig. 3 represents the global process of the proposed approach.

Firstly, in the offline step, each model is composed into several parts. This decomposition will reduce the complexity and highlight the topology of the 3D model. Then we calculate for each object, the different descriptors associated with each segment using our descriptor cited before [4]. In the online step, we propose a new strategy for computing the similarity between the segments of the request object and objects in the database. When a query is presented, we firstly extract its constituent parts and for each segment, we calculate its descriptor. Then, to compute how similar two objects are, a mapping stage is done by searching the best corresponding descriptor of each segment in the query and an object form the database. Taking Q as a descriptor of a segment from the query object and {Vi, V2, ..., Vn} represent a set

of descriptors associated to an object from the database; the best correspondence of Q is deduced by minimizing the following function:

Sim(Q,Vt) = min{D(Q,V), VV e V}, (1)

where t represent the index of the best corresponding descriptor of Q and D is the city block distance.

"t Offline step)"

Search results Fig. 3. The global process of the proposed approach

The Fig. 4 describes an example of correspondence between segments

When the number of segments in the query and an object from the database is different, calculating only the similarity between objects does not reflect the real correspondence between these models. For this reason, we propose to take into account the dissimilarity between objects in the global distance by adding the maximum deviation of unmapped segments computed as:

Dis(Q, Uu) = max{D(Q, Ux), V Ux e U}, (2)

where U is a set of unmapped segments.

Fig. 4. An example of correspondence between segments

The measure of similarity between objects is based on two criteria:

- The distance between the best corresponding seg-

ments;

- The maximum deviation of unmapped segments. These two metrics are combined to obtain the final matching result between two objects O1 and O2 using the following formula:

GlobalDis(Ol,O2) = Sim(O1,O2) + Dis(O,,O2). (3)

Using this partial similarity approach, two models are considered similar if their segments are similar. Consequently, we can perform a similarity search not only with the 3D models in their integrality but also with their different parts, which improves the efficiency of the content-based retrieval systems.

3. Experimental results The last section of the present paper is dedicated to evaluate and validate the proposed method. Through four sets of tests, we will try to show the effectiveness and the discriminative power of the proposed method, compared with other well-known which are PANORAMA [11], LightField [9], Harmonics [16], and our previously proposed method multi-criteria with DEA [4].

First, and before starting the experimental results, we should choose which database to use in our experimental tests. Many databases can be founded freely over the internet we can mention the Princeton shape benchmark (PSB) [35], the Shape Recognition Contest (SHREC), the National Taiwan University database, the Konstanze 3D Model Benchmark (CCCC) [36], or The NIST Generic Shape Benchmark (NSB) [37]. Our choice went to use the Princeton's segmentation benchmark database [38], which is a modified version of the Watertight Track of the 2007 SHREC Shape-based Retrieval Contest [39]. This choice has been made because of the number and the diversity of this database, it contains 380 objects divided into 19 categories (Human, Cup, Glasses, Airplane, Ant, Chair, Octopus, Table, Teddy, Hand, Plier, Fish, Bird, Armadillo, Bust, Mech, Bearing, Vase, and Fourleg). In addition, this database contains some noisy 3D models, and it will be a challenging task to retrieve them using our proposed method.

The first test is done to compare our previously published works for combining many features using DEA to generate a global descriptor for the 3D object [4] with the proposed one. In this test, we will compare the two methods on different classes; we choose (Human, Cup, Bust, and Fourleg). Fig. 5 shows the obtained results. From these results, we can easily notice that the proposed method outperform the global version of the DEA[4] in all the chosen classes, even if both methods are based on the same Multicriteria method, but the proposed one with the partial comparison add-on succeeded to ameliorate the performance of the proposed method.

The second test is a classic one and used to evaluate almost every information retrieval method; it is the precision-recall curves. The recall is the percentage of the relevant retrieved item to the total number of pertinent item in the database, and the precision is the percentage of relevant retrieved 3D objects over the whole number of the retrieved object. Mathematically they are represented as follows:

relevant correctly retrieved

Precision =-, (4)

all retrieved

r ll = relevant correctly retrieved (5)

all relevant

This test was achieved by taking each 3D model as a query on the rest of the database, then compute the average precision-recall performance overall models. Fig. 6 represent the obtained result along with those obtained for the methods: PANORAMA [11], LightField [9], Harmonic [16], and our previously proposed method multicri-teria with DEA [4]. As we can see from the results, our method came in the first place followed closely by PANORAMA [11], while harmonics [16], LightField [9] and DEA perform almost the same and have been outperformed by the proposed method. We have achieved excellent performance especially for the categories including articulated objects compared to global approaches and view based approaches (Fig. 7). This superiority of the performance of the partial approach is due to the simplification of the shape into several simple shapes in order to highlight similar parts between objects of different poses.

In the third test, we will validate the performance of our proposed partial retrieval approach by measuring some evaluation metrics:

- The nearest neighbor: this metric consists on calculating the percentage of the closest retrieved elements belonging to the same class of the query.

- First Tier and Second Tier: these two measures calculate the percentage of objects belonging to the query class that appear in the top K matches, where K depends on the query class size. Let consider | C| as the size of the class, K = | C| - 1 for the first tier, and K = 2*(| C| - 1) for the second tier.

- Discounted Cumulative Gain (DCG): a score that calculates the right results ahead of the list rather than the correct results at the end of the ranking list, knowing that a user is less likely to consider the items at the end of the list.

- F-Measure: The F-Measure based on combining the recall and precision values to measure the overall performance of the retrieval system. We get the F-mea-sure by the following formulas:

„ ^ „ Precision x Recall

FMeasure = 2 x--(6)

Precision + Recall

Table 2 present the obtained results using our approach and the same methods used in the previous test.

Table 2. The obtained result using our approach and the same methods

Descriptors / Scalar Metrics NN+1 1st Tier 2nd Tier Normalised DCG F-Mea-sure

Our approach 0.95 0.71 0.42 0.84 0.32

DEA Descriptor [4] 0.74 0.52 0.34 0.82 0.32

Harmonics [16] 0.75 0.49 0.32 0.81 0.30

LightField [9] 0.84 0.56 0.35 0.82 0.31

Panorama [11] 0.92 0.71 0.41 0.83 0.32

Relevant correctly retrieved

18 16 14 12 10 8 6 4 2 0

rrj CT) rr> (T) rn O") rn PT) O"! Pr> (V) fy-j PT) f*") Pr} Pfj PT} (V)

/

/ ( » V /

/ » /

h i>

\ 7

iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.

< > <■

\

Relevant correctly retrieved

■v V 1

s ■-I 's. l-l ■s. / v. / \ ■s. \

\ } ■s, / \

« ) ■ { Î »

! » M »

! \ Î

i i> / / \ i

\ < »

—■— Our approach —■ DEA Descriptor

i > Cuf ?

20 18 16 14 12 10 8 6 4 2 0

■ DEA Descriptor

M ■v.

\ \ / \ 1 s / \ l-B

\ \ / \ /

/ \ \ /

.! I \ / \ 1

< f \ \ *x

: < » f il Î "X 1 i

T \ ä ( sr*

( il Four leg

0000û000°0000000000\0\0s0\0\0\0i0\0\©\cs

(y^crirrjeriPriPriPrirneriPrirr^rriivirriPriPricr^rrirrj^j-

Relevant correctly retrieved

18 16 14 12 10 8 6 4 2 0

—■— Our approach —■ DEA Descriptor

/ \ ■v.

\ \ / \ / /\ A

■ / 1 Î.

[ K. / •

j i \

'Î f, : i

M >

Hun tan

Fig. 5. A comparison between the obtained results using our approach and DEA Descriptor for some classes

Precision 1.0 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0

....

\

Nv K

•ïn

Ui

-♦ c ur approach anorama ehtField

_ -*—L

----DEA Descriptor -»---Harmonics

Re call

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0

Fig. 6. Precision-Recall graph using our proposed approach and four different descriptors

Precision 1.0 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0

Y

-♦—Our

approach \

.......Panorama

-*-■ LightField ■■— DEA Descriptor ——Harmonics

- -— - __

v

X

N.

Ree all"

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0

Fig. 7. Precision-Recall graph using our proposed for articulated objects

The obtained results in this test are in concordance with those obtained in the precision-recall curves. Our proposed approach provides the best results in all the computed metrics, followed by PANORAMA [11], with a small difference. LightField [9] and DEA Descriptor [4] came next with average result, and Harmonics [16] in the last place.

In addition to the relevance and the effectiveness of a retrieval method, another important point needs to be verified is the response time. Indeed once the user submitted the query, the retrieval system should be very responsive and provide the user with the best results instantly. The last teste in our paper will compare the response time of our method compared to PANORAMA [11] method since they both performed very well and provided very good results. To do so, we use every model in the database as a query and compute the time needed for both methods to return the results, and then we compute this time per class, Fig. 8 shows the obtained results.

Time in second 500 450 400 350 300 250 200 150 100 50 0

—■— Panorama ■■■■Our approach /

s ■s

1 -i i-i i. i l-l / 1

I" r 1 ■-I M t

|i ( ;

\ f

1 ! » :

I S' \ / ;

i i M A r i

Clos ses

1 3 5 7 9 11 13 15 17 19

Fig. 8. The response time of our method compared to PANORAMA method

Our method succeeded to provide results in a satisfactory amount of time outperforming the PANORAMA method [11] in almost all classes (like Bust, Plier, cup...), except for octopus, where PANORAMA [11] slightly outperform our method.

From all the previous experiments, we can demonstrate that the proposed method is very responsive by providing an excellent result, in a reasonable time.

Conclusion

In this paper, we have proposed a novel approach for 3D mesh retrieval based on partial matching. Firstly, each 3D model is segmented into its constituent parts, and then shape descriptors are computed from these segments based on data envelopment analysis. Finally, a new technique has been applied to compare similarities between descriptors of segments. The experimental results illustrated the ability of the proposed approach in 3D shape retrieval system and its discriminative power in distinguishing between similar and dissimilar models in a reasonable time.

References

[1] Ioannakis G, Koutsoudis A, Pratikakis I, Chamzas C. RETRIEVAL - An online performance evaluation tool for information retrieval methods. IEEE Transactions on Multimedia 2018; 20(1): 119-127. DOI: 10.1109/TMM.2017.2716193.

[2] Yang Y, Lin H, Zhang Y. Content-based 3-D model retrieval: A survey. IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews 2007; 37(6): 1081-1098. DOI: 10.1109/TSMCC.2007.905756.

[3] Lara López G, Peña Pérez Negrón A, De Antonio Jiménez A, Ramírez Rodríguez J, Imbert Paredes R. Comparative analysis of shape descriptors for 3D objects. Multimedia Tools and Applications 2017; 76(5): 6993-7040. DOI: 10.1007/s11042-016-3330-5.

[4] Bouksim M, Zakani FR, Arhid K, Aboulfatah M, Gadi T. New approach for 3D Mesh Retrieval using data envelopment analysis. International Journal of Intelligent Engineering and Systems 2018; 11(1): 98-107. DOI: 10.22266/ijies2018.0131.01.

[5] Kazmi IK, You L, Zhang JJ. A survey of 2D and 3D Shape descriptors. In Book: 2013 10th International Conference Computer Graphics, Imaging and Visualization, IEEE, 2013, Macau, China; 1-10. DOI: 10.1109/CGIV.2013.11.

[6] Guo Y, Bennamoun M, Sohel F, Lu M, Wan J, Kwok NM. A comprehensive performance evaluation of 3D local feature descriptors. International Journal of Computer Vision 2016; 116(1): 66-89. DOI: 10.1007/s11263-015-0824-y.

[7] Li B, Lu Y, Li C, et al. A comparison of 3D shape retrieval methods based on a large-scale benchmark supporting multimodal queries. Computer Vision and Image Understanding 2015; 131: 1-27. DOI: 10.1016/J.CVIU.2014.10.006.

[8] Liu A, Li W, Nie W, Su Y. 3D models retrieval algorithm based on multimodal data. Neurocomputing 2017; 259: 176-182. DOI: 10.1016/J.NEUCOM.2016.06.087.

[9] Chen D-Y, Tian X-P, Shen Y-T, Ouhyoung M. On visual similarity based 3D model retrieval. Eurographics 2003; 22(3): 223-232. DOI: 10.1111/1467-8659.00669.

[10] Ohbuchi R, Nakazawa M, Takei T. Retrieving 3D shapes based on their appearance. In Book: 2003 5th ACM SIGMM International Workshop on Multimedia Information Retrieval, ACM, 2003 Berkeley, California, USA; 39-45. DOI: 10.1145/973264.973272.

[11] Papadakis P, Pratikakis I, Theoharis T, Perantonis S. Panorama: A 3D shape descriptor based on panoramic views for unsupervised 3D object retrieval. Int J Comput

Vis 2010; 89(2-3): 177-192. DOI: 10.1007/s11263-009-0281-6.

[12] Osada R, Funkhouser T, Chazelle B, Dobkin D. Shape distributions. ACM Transactions on Graphics 2002; 21(4): 807-832. DOI: 10.1145/571647.571648.

[13] Zaharia T, Preteux FJ. 3D-shape-based retrieval within the MPEG-7 framework. Nonlinear Image Processing and Pattern Analysis 2001: 133-145. DOI: 10.1117/12.424969.

[14] Koenderink JJ, van Doorn AJ. Surface shape and curvature scales. Image and Vision Computing 1992; 10(8): 557-564. DOI: 10.1016/0262-8856(92)90076-F.

[15] Akgul CB, Sankur B, Yemez Y, Schmitt F. Density-based 3D shape descriptors. Eurasip Journal on Advances in Signal Processing 2007. DOI: 10.1155/2007/32503.

[16] Funkhouser T, Min P, Kazhdan M, et al. A search engine for 3D models. ACM Transactions on Graphics 2003; 22(1): 83-105. DOI: 10.1145/588272.588279.

iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.

[17] Cook WD, Kress M. A data envelopment model for aggregating preference rankings. Management Science 1990; 36(11): 1302-1310. DOI: 10.1287/mnsc.36.11.1302.

[18] Bouksim M, Arhid K, Zakani FR, Aboulfatah M, Gadi T. New approach for 3D Mesh Retrieval using artificial neural network and histogram of features. Scientific Visualization 2018; 10(2): 84-94. DOI: 10.26583/sv.10.2.07.

[19] Suzuki MT, Yaginuma Y, Yamada T, Shimizu Y. A partial shape matching method for 3D model databases. Software Engineering and Applications 2005. Source: (http://www.actapress.com/Abstract.aspx?paperId=23894).

[20] Biasotti S, Marini S, Spagnuolo M, Falcidieno B. Sub-part correspondence by structural descriptors of 3D shapes. CAD Computer Aided Design 2006; 38(9): 1002-1019. DOI: 10.1016/j.cad.2006.07.003.

[21] Moumoun L, Chahhou M, El Far M, Haqiq A, Gadi T. 3D object retrieval using a global-partial analogy and the bayesian approach. In Book: 2011 Seventh International Conference on Signal Image Technology {&} Internet-Based Systems, IEEE, 2011, Dijon, France; 314-321. DOI: 10.1109/SITIS.2011.60.

[22] Shapira L, Shamir A, Cohen-Or D. Consistent mesh partitioning and skeletonisation using the shape diameter function. The Visual Computer 2008; 24(4): 249-259. DOI: 10.1007/s00371-007-0197-5.

[23] Rafii Zakani F, Arhid K, Bouksim M, Aboulfatah M, Gadi T. A new evaluation method for mesh segmentation based on the levenshtein distance. International Review on Computers and Software (IRECOS) 2016; 11(12). DOI: 10.15866/irecos.v11i12.10922.

[24] Rafii Zakani F, Arhid K, Bouksim M, Gadi T, Aboulfatah M. Kulczynski similarity index for objective evaluation of mesh segmentation algorithms. In Book: 2016 5th International Conference on Multimedia Computing and Systems (ICMCS), IEEE, 2016, Marrakech Morocco; 1217. DOI: 10.1109/ICMCS.2016.7905611.

[25] Rafii Zakani F, Arhid K, Bouksim M, Aboulfatah M, Gadi T. New measure for objective evaluation of mesh segmentation algorithms. In Book: 2016 4th IEEE International Colloquium on Information Science and Technology (CiSt), IEEE, 2016, Tanger Morocco; 416421. DOI: 10.1109/CIST.2016.7805083.

[26] Bouksim M, Zakani FR, Arhid K, Gadi T, Aboulfatah M. Evaluation of 3D mesh segmentation using a weighted version of the Ochiai index. In Book: 2016 IEEE/ACS 13th International Conference of Computer Systems and Applications (AICCSA), IEEE, 2016, Agadir Morocco; 17. DOI: 10.1109/AICCSA.2016.7945640.

[27] Arhid K, Bouksim M, Rafii Zakani F, Gadi T, Aboulfatah M. An objective 3D mesh segmentation evaluation using Sokal-Sneath metric. In Book: 2016 5th International Conference on Multimedia Computing and Systems (ICMCS) 2016: 29-34. DOI: 10.1109/ICMCS.2016.7905609.

[28] Bouksim M, Rafii Zakani F, Arhid K, Aboulfatah M, Gadi T. New evaluation method for 3D mesh segmentation. In Book: 2016 4th IEEE International Colloquium on Information Science and Technology (CiSt), IEEE, 2016, Tanger Morocco; 438-443. DOI: 10.1109/CIST.2016.7805087.

[29] Liu Z, Tang S, Bu S, Zhang H. New evaluation metrics for mesh segmentation. Computers and Graphics 2013; 37(6): 553-564. DOI: 10.1016/j.cag.2013.05.021.

[30] Zakani FR, Bouksim M, Arhid K, Aboulfatah M, Gadi T. Segmentation of 3D meshes combining the artificial neural network classifier and the spectral clustering. Computer Optics 2018; 42(2): 312-319. DOI: 10.18287/2412-61792018-42-2-312-319.

[31] Golovinskiy A, Funkhouser T. Randomized cuts for 3D mesh analysis. ACM Transactions on Graphics 2008; 27(5): 1. DOI: 10.1145/1409060.1409098.

[32] Attene M, Falcidieno B, Spagnuolo M. Hierarchical mesh segmentation based on fitting primitives. The Visual Computer 2006; 22(3): 181-193. DOI: 10.1007/s00371-006-0375-x.

[33] Shymon Shlafman, Ayellet Tal SK, Shlafman S, Tal A, Katz S. Metamorphosis of polyhedral surfaces using decomposition. Computer Graphics Forum 2002; 21: 219228. DOI: 10.1111/1467-8659.00581.

Authors' information

Khadija Arhid (b. 1986) obtained her Bachelor degree and her Master degree respectively in 2009 and 2011 from Science and Techniques faculty University Hassan 1st Settat, Morocco. Currently a Ph.D student in the Laboratory of Informatics, Imaging and Modeling of Complex Systems (LIIMCS). Her research interests are about segmentation evaluation and retrieving of 3D models. E-mail: khadija. arhid@gmail. com.

Fatima Rafii Zakani (b. 1986) obtained her Bachelor degree in 2009 from Science and Techniques faculty University Hassan 1st Settat, Morocco. In 2011, she got a Master degree in software quality from the same faculty, and now she is a Ph.D student in the Laboratory of Informatics, Imaging and Modeling of Complex Systems (LIIMCS). The interests of her research are segmentation evaluation and retrieving of 3D models. E-mail: _ [email protected].

Basma Sirbal (b. 1990) obtained her Bachelor degree and her Master degree respectively in 2012 and 2014 from the Science and Techniques faculty University Hassan 1st Settat, Morocco. Currently a Ph.D student in the Laboratory of Informatics, Imaging and Modeling of Complex Systems (LIIMCS). Her research interests are about evaluation and retrieving of 3D models. E-mail: sirbal.basma@gmail. com.

Mohcine Bouksim (b. 1987) got his Bachelor degree in computer science in 2009 from the Science and Techniques faculty University Hassan 1st Settat, Morocco. Followed by a Master degree in software quality from the same faculty. Now preparing his Ph.D degree in the Laboratory of Informatics, Imaging and Modeling of Complex Systems (LIIMCS). His research interests include segmentation evaluation and retrieving of 3D models. E-mail: mbouksim@gmail. com.

Mohamed Aboulfatah. Professor and former head of the of Applied Physics department at the Sciences and Techniques faculty, Hassan 1st University Settat, MOROCCO. Member of the Laboratory of Analysis of Systems and Treatment of Information. E-mail: mohamed. aboulfatah@uhp. ac.ma.

Taoufiq Gadi. Professor at the Computer Science department in the Science and Techniques faculty University Hassan 1st Settat, Morocco and head of the laboratory of Informatics, Imaging and Modeling of Complex Systems (LIIMCS) at the same faculty. E-mail: [email protected].

Received July 16, 2018. The final version - February 18, 2019.

[34] Arhid K, Rafii Zakani F, Mohcine B, Aboulfatah M, Gadi T. An efficient hierarchical 3D Mesh Segmentation using negative curvature and dihedral angle. International Journal of Intelligent Engineering and Systems 2017; 10(5): 143-152. DOI: 10.22266/ijies2017.1031.16.

[35] Shilane P, Min P, Kazhdan M, Funkhouser T, Street O. The Princeton shape benchmark. SMI '04 Proc Shape Modeling International 2004: 167-178.

[36] Li B, Godil A, Aono M, Bai X, Furuya T, Li L, López-Sastre R, Johan H, Ohbuchi R, Redondo-Cabrera C, Tatsuma A, Yanagimachi T, Zhang S. SHREC'12 Track: Generic 3D shape retrieval. Proc 5th Eurographics conference on 3D Object Retrieval 2012: 119-126. DOI: 10.2312/3DOR/3DOR12/119-126.

[37] Fang R, Godil A, Li X, Wagan A. A new shape benchmark for 3D object retrieval. In Book: Bebis G, Boyle R, Parvin B, Koracin D, Remagnino P, Porikli F, Peters J, Klosowski J, Arns L, Chun YK, Rhyne T-M, Monroe L, eds. Advances in visual computing. Berlin, Heidelberg: Springer-Verlag; 2008: 381-392. DOI: 10.1007/978-3-540-89639-5_37.

[38] Chen X, Golovinskiy A, Funkhouser T. A benchmark for 3D mesh segmentation. ACM Transactions on Graphics 2009; 28(3): 73. DOI: 10.1145/1531326.1531379.

[39] Giorgi D, Biasotti S, Paraboschi L, Imati CNR. SHape REtrieval Contest 2007: Watertight models track. 2007. Source: (https://pdfs.semanticscholar.org/2b5b/b396160d1 1da2bc842b58045704cab70aa8c.pdf).

i Надоели баннеры? Вы всегда можете отключить рекламу.