更全的杂志信息网

A Dual-Platform Laser Scanner for 3D Reconstruction of Dental Pieces

更新时间:2016-07-05

1.Introduction

Dental cavity preparation is a basic clinical operation skill in oral medicine.The cavity,which is used to contain filler material in order to restore the shape and function of the tooth,is formed by removing caries lesion with dental surgery.Rigorous criteria for the cavity in terms of depth,length,width,and angle make its assessment an important work in clinical teaching.Digital assessment that uses computer-assisted three-dimensional(3D)reconstruction has now become an important means for dental teaching;however,the digital assessment systems that are mainly used are expensive and still need to be improved in terms of blind area and precision[1,2].3D laser scanning has the advantages of high precision,fast speed,and easy implementation[3-6].This method projects the laser onto the object and collects images of the object with the laser stripe,thus actively forming triangle similarity relationships between the images and objects.Calibration is critical for laser scanning,as it determines the validity and precision of the measurement results.

There are two main problems in calibration.The first is the question of how to collect a substantial number of accurate calibrating points using appropriate methods.The wire-drawing method[7]and dentiform bar method[8]that were proposed early depend on expensive external equipment and gain few calibrating points.Although Huynh etal.[9]achieved high-precision calibrating points based on the invariance of the cross-ratio,these calibrating points are sometimes insufficient.At present,a planar target is widely used to collect the calibrating points due to its simple fabrication and flexible operation[10-12].For a rotation scan,the rotation axis must also be calibrated[13-15].Most of the abovementioned methods involve complicated artificial operations.Convenient calibration is becoming important,because recalibration must be done frequently in order to eliminate errors caused by movements or environmental changes.

The second problem is how to calculate the parameters using an appropriate algorithm.Calibration algorithms can be divided into two types:the mathematical method and the machine-learning method.The mathematical method establishes mathematical formulas according to the principle of 3D laser scanning.Due to imaging restorations,structure errors,and other uncertainties,complete and precise mathematical formulas usually turn out to be very complex.The machine-learning method builds transformation relations between image coordinates and spatial coordinates directly using artificial neural networks(ANNs)and genetic algorithms[16,17].As a black box algorithm,the machine-learning method does not require camera calibration and mathematical formulas;however,it has disadvantages such as low convergence and poor generalization.This paper presents a dual-platform scanner for dental reconstruction and assessment,and proposes a method of hybrid calibration for laser scanning to improve the convenience and precision.

2.Methodologies

2.1.Laser scanning

In 3D laser scanning,when the line of the laser is projected onto the object being measured,an image of the part of the object with the light stripe is acquired by the camera,as shown in Fig.1.If P is a point on the object being measured,its image Pappears to be on the light stripe in the image plane when it is scanned by the laser.The world coordinates frame o w x w y w z w describes the 3D information of the object.The camera coordinates frame o c x c y c z c and the image coordinates frame o0xy are established with an origin of o c and o0,where o c is the optical center and o0 is the intersection of the optical axis and image plane.The distance between o c and o0 is f,which is also called the focal length.The pixel array on a complementary metal-oxide semiconductor(CMOS)camera is expressed by ou v.As the position of Pin the ou v can be found through image processing,the principle is to derive the transformation from ou v to o w x w y w z w.

If the subscript of o0 in the pixels array is u0,v0( ),then the transformation from ou v to o0xy is

where sx and sy,as given by the camera manufacturer,are the physical dimensions of a pixel on the CMOS camera in the corresponding direction.

In the ideal pinhole imaging model of the camera,the proportional relationship between P( x c ,y c,z c )and P(x,y)is

The transformation from o0xy to o c x c y c z c is based on this proportional relationship,which is usually expressed in the form of a homogeneous matrix,as follows:

Meanwhile,a rigid body transformation occurs between o w x w y w z w and o c x c y c z c in 3D space.Supposing that R is a 3×3 rotation matrix and T is a translation vector,the transformation is

Fig.1.Principle of 3D laser scanning.

Thus,we can derive the transformation from ou v to o w x w y w z w from Eqs.(1),(3),and(4).

Eq.(5)is the camera model,where M1 is the intrinsic parameter matrix and M2 is the extrinsic parameter matrix.The model can also be written as a projection matrix M,as shown in Eq.(6).

口服支链氨基酸对肝细胞癌患者行肝切除术或射频消融术后肝细胞癌复发率和白蛋白水平影响的Meta分析…………………………………………………… 薛文鑫等(23):3274

In 3D laser scanning,the world coordinates axis x w is usually parallel to the scanning direction,so x w can be acquired directly by the scanner.The other 3D information,(y w ,z w ),is worked out by eliminating z c in Eq.(6):

Eq.(7)is the basic model of 3D laser scanning.This is an ideal model under ideal conditions.However,a variety of nonlinear distortions occur in practical application.The main distortions that affect the imaging results are radial distortion and tangential distortion[18].Radial distortion and tangential distortion come from the shape of the lens and the assembly of the camera,respectively.Their distortion models are

Eq.(14)can be deduced into a specific form through the chain rule:

2.2.Calibration methods

As stated above,calibration establishes the transformation relationships between the pixel array( u, v)and the world coordinates(y w ,z w ).In general,there are two kinds ofmethod:the mathematical method and the machine-learning method.

where y is the sample data,which consists of the ideal value f and the residual part e that contains distortions and errors.In Eq.(16),both sides are divided by fi.Since e/f is close to zero,the final normalization value is close to that of the ideal model.

The mathematical method establishes mathematical formulas based on the calibration principle first,and then works out the unknown parameters of these formulas through nonlinear optimization.The Tsai's two-step method[19]and the Zhang's method[20]are the most widely used forms of the mathematical method.The Tsai's two-step method uses a 3D calibration target,while the Zhang's method uses a planar calibration target.In the Zhang's method,several planes in different positions are used to calculate the parameters,because points on each plane can be used to set up two equations.Zhang's calculated the initial values of the parameters under the assumption of no distortion,and then worked out distortion coefficients with these initial values by the least squares method.Precision is optimized by maximum likelihood estimation.

For the dual-platform scanner,calibration involves finding the coordinate transformation from image coordinates to world coordinates in the translation scan first;next,the dip β and O r(y r ,z r )is found in the rotation scan.We use an integrative method to collect the calibrating points.The integrative method can conveniently collect a substantial number of calibrating points and can perform an integrative calibration for both the translation and rotation scans.Furthermore,we propose a hybrid algorithm to establish an effective model.This hybrid algorithm can achieve higher precision by combining the mathematical and machinelearning methods.

Because (u0 ,v0)can be determined through the optical method,(x d ,y d )are known data.The intermediate parameters,r1/ty,r2/ty,r3/ty,tx/ty,r4/ty,r5/ty,and r6/ty,can be worked out from Eq.(10),if there are more than seven calibrating points.First,the extrinsic parameters,R,tx,and ty,are calculated based on the orthogonality of the rotation matrix.The other parameters,f,k1,and tz,are approached based on the camera and distortion model by nonlinear optimization.

The machine-learning method establishes the transformation relationship between the input( u, v)and output( y w ,z w )directly by training sample data.In essence,this is a black box method that requires no intrinsic or extrinsic parameters.ANNs are typical machine-learning algorithms.For example,the back-propagation network(BPN,which is a kind of ANN)has been shown to be an effective method for building nonlinear mapping relationships with high versatility and precision[21,22].With the steepest descent method,the BPN can adjust its weights and thresholds to learn the mapping relationship according to the backpropagation errors.As shown in Fig.2,its structure consists of an input layer,hide layer,and output layer.Each layer has several nodes that are similar to biological nerve cells.

The learning process of the BPN has two directions.The forward propagation of data realizes an estimated mapping relationship from n dimensions to m dimensions,while the back propagation of errors helps to revise this mapping relationship.In forward propagation,the input data flow to the hide layer and then to the output layer.For a nude hk in the hide layer,the value is determined by the threshold ak,the related input data xi,and the corresponding weights v ki:

where Vk=[ak v k1 v ki ··· v knT,X=[1 x1 xi ··· xn],f1 is the activation function,and Sk is the node's net input.Similarly,for a nude yj in the output layer,the value is determined by the threshold bj,the related hk,and the corresponding weights wjk.

whereis the activation function,and Sj is the node net input.In back propagation,the errors between the desired output and the actual output are used to adjust the weights and thresholds in order to minimize the global error function.If the size of the learning samples is P,then the global error function is:

Fig.2.Structure of a three-layer BPN.

where Ep is the error of the p th sample andis the desired output.Changes in the weights and thresholds are calculated based on the partial differential of Ep with a learning rate ofη,which in the output layer and the hide layer is:

where x d and y d are real imaging positions;x and y are ideal imaging positions;r2=x2d+y2d;k1,k2,and k3 are radial distortion coef ficients;p1 and p2 are tangential distortion coefficients.In this case,f,u0,v0,R,T,k1,k2,k3,p1,and p2 need to be determined through calibration before the scanner begins the measurement.

The network structure gives the BPN a strong nonlinear mapping ability.To apply the BPN,(u, v)and( y w ,z w )are seen as input and output data.The calibration can be completed by a learning process based on Eqs.(11),(12),and(15).

The mathematical method is specific and robust,but it is dif ficult to work out the mass of the parameters.The mathematical formulas usually only concern the main distortions to be kept simple,which makes the formulas unable to handle other nonlinear factors and uncertainties.The machine-learning method can deal with all the imaging restorations,structure errors,and other uncertainties.Thus,it seems to be quite appropriate for the calibration of laser scanning.However,the expected results cannot be achieved in practice.In addition,this method is apt to plunge into the local minimum,in what is known as over fitting or poor generalization.Poor generalization means that the network performs rather worse with testing samples than with training samples.In this case,only the calibrating points can be measured.In general,the distortions and errors are two orders of magnitude smaller than the ideal values determined by the basic model.Both the mathematical and machine-learning methods process the data directly,which causes the distortions and errors to be concealed by the ideal values.This is an important in fluencing factor on precision that has been ignored.It can be revealed by normalization,which is a common step in data processing:

现针对旋转整流器3大类故障,分别获取50个样本,每种故障模式随机抽取25个样本作为训练样本,剩余25个样本作为测试样本,验证基于小波变换的旋转整流器故障诊断方法,诊断正确率为100%,表明基于小波变换的旋转整流器故障诊断方法能够有效地诊断旋转整流器。

客服工作基本可分为人工客服和电子客服,其中人工客服又可细分为文字客服、视频客服和语音客服三类,根据服务类型的特点,招聘客服人员的要素主要有专业技能、职业素养、道德素质三方面。

3.The dual-platform laser scanner

In this paper,a dual-platform laser scanner based on the laserscanning principle is designed for the 3D reconstruction of dental pieces.In dental cavity preparation,the cavity may be on the front or lateral of a tooth.Dental pieces with a cavity on the lateral can only be scanned by means of a rotation platform,whereas those with a cavity on the front are suitable for a translation platform.The dual-platform structure makes it possible to scan all types of dental model with the 3D laser scanner system.As shown in Fig.3,the scanner consists of two cameras,a laser transmitter,and two platforms.The rotation platform is fixed to the translation platform,so it is possible to switch over the working platform through the translation platform.When in rotation scan mode,the rotation center O r is moved in the laser plane according to the mark on the rotation platform.The rotation platform maintains a dip,β,with the horizontal x w o w y w plane in order to ensure that the object can be scanned entirely.Two cameras are used in the system to collect images from different sides;this effectively eliminates blind areas and ensures the integrity of the point cloud.

In the translation scan,the direction of the x w axis is set parallel to the movement of the translation platform.This direction is perpendicular to that of the laser plane,which is also the plane of y w o w z w.When the system operates,the x w coordinates are obtained from the control module of the translation platform.Simultaneously,(y w ,z w )are calculated based on the calibration results.In the rotation scan,the scanner obtains a set of twodimensional(2D)physical coordinates( y w ,z w )each time the rotation platform revolves.These physical coordinates must be transformed and assembled into the 3D point cloud (x wr,y wr,z wr ).There are two steps in this process.First,eliminate the tilt of the rotation platform with the dipβand the rotation center O r(y r ,z r),as shown in Eq.(17).Second,assemble the physical coordinates together one by one according to the rotated angle θ,as shown in Eq.(18).The rotated angle θ can be obtained from the control module of the rotation platform,whereas β and O r(y r ,z r )need additional calibration.

Its matrix form is

Fig.3.Design of the dual-platform laser scanner.

Fig.4.Experimental facilities for the dual-platform laser scanner.(a)The dualplatform laser scanner;(b)the translation platform and gauge;(c)the rotation platform and pattern.

4.Hybrid calibrations

In the Tsai's two-step method,since only quadratic radial distortion is considered,the radial arrangement constraint is applied:

4.1.Integrative method

In the calibration of the translation scan,the stepped gauge is placed on the translation platform.When the stepped gauge moves with the translation platform,the laser projects onto different treads.The images of the treads obtained with the laser can be processed to extract a substantial number of calibrating points.The centers of the light stripe on the image are extracted as image coordinates through the Gaussian fitting method[23],while the world coordinates are gained from the physical dimension.In addition,the transformation of coordinates from image coordinates to world coordinates can be performed through the hybrid algorithm.In the calibration of the rotation scan,the pattern is pasted on the rotation platform.The coordinates of a line on the rotation platform are gained through transformation.The dip β is calculated by the slope of this line.Because the center of rotation is on the laser plane,O r can be determined through two images that are snapped before and after rotating by 180°.As shown in Fig.5,P1 refers to the endpoints of the light stripe on the pattern.The corresponding points after rotating by 180°are referred to as.P1 andare symmetrical to O r,which can be used to calibrate O r(y r ,z r ).In general,it is necessary to collect data and perform the calibration several times;the average result is the final result.Next,P2 and are used to calculate the error in the calibration results after these results are obtained.

4.2.Hybrid algorithm

Fig.5.The symmetrical property of the rotation scan.(a)Initial position;(b)rotated 180°.

Based on the discussion on calibrating algorithms,we propose a hybrid algorithm that combines the mathematical method and the machine-learning method.In this hybrid algorithm,the mapping relationship is divided into two parts:the main part and the compensation part.The main part is determined by the basic model of laser scanning,while the compensation part contains all the distortions and errors,as shown in Fig.6.The final mapping relationship is made up of the basic model and the network.To establish the hybrid model,the mathematical method is used first in order to work out the basic model.Next,taking the residual between the main part and the real value as the output,the machine-learning method is used to establish the network.

分油机仿真面板的原理图设计在完成之后,借助Altium Designer板卡设计软件绘制原理图并给原理图中的每一个元件编号,在将原理图导入到PCB图之前需要对原理图以及PCB图进行编译(Compile)。受安装环境的影响,PCB板的大小不得超过110 mm×120 mm,设计为双层板,通过螺柱固定在控制箱上,设计的板卡PCB见图4。

其中m个公共因子F1,F2…Fm和特殊因子,组成。若用矩阵表示,则是这一高度“数学化”的模型,往往让文科学习者“如坠云雾”。

The basic model is provided in Eq.(7);this can be replaced by the following:

本文主要集中研究三方面内容:首先,全面宏观调查分析学生译文中存在的问题以及导致问题出现的原因;其次,根据语言学家对总结错误原因的分类,梳理、统计学生的译文,对错误译文进行量化;最后,结合译文分析研究对学生译文中的错误进行描述和解释。

A dual-platform laser scanner was constructed,as shown in Fig.4(a).Each camera had a resolution of 1280×1024 and an effective view field of 20 mm×18 mm.The physical dimensions,sx and sy,of a pixel were 5.2μm×5.2μm.The calibration target for the translation scan was a stepped gauge with five smooth treads,as shown in Fig.4(b).Each step had a height of 2 mm,and a length and width of 20 mm×5 mm.The calibration target for the rotation scan was a pattern,as shown in Fig.4(c).A white circle with a diameter of 10 mm was positioned in the middle.

where

In calibration,since there are far more calibrating points than unknowns,a1-a9 can be worked out through the least squares method:

希腊神话本不是历史教学的内容,学生能否正确选出这道题的正确答案就看是否能够将希腊神话诞生的历史背景和人文主义思想联系起来。本题考查人文思想诞生的背景,解题的时候一是要关注时间,二是找准材料的关键词。我们会发现希腊神话在人文思想诞生前已经存在,再结合神话中对诸神性情的描述,与人文思想进行对比会发现二者的相似之处:关注人。于是可以大胆得出结论:人文思想根植于传统文化。这道题就是一道非常典型的源于教材而又超越教材的题,对学生知识迁移能力的考查十分到位。

根据携程近期发布的《2018“全球旅行SOS”报告》显示,中国旅游者海外求助有5大类型最为常见:指导补办证件、尽量协助就医、协助物品带回、协调翻译服务、行李延误协助。

The BPN is used as compensation in order to learn the mapping relationship of the distortion and errors.The input data are the pixels array(u,v),while the output data are the residualbetween the main part and the real value Y real.

Fig.6.The hybrid algorithm.

The network has three layers,with two nodes in the input layer and two nodes in the output layer.The hybrid algorithm is superior to the mathematical and machine-learning methods,as it combines the advantages of both methods while overcoming their shortcomings.When compared with a pure mathematical method,the hybrid model is more complete than the mathematical formulas,because all the distortions and other errors can be compensated for by the network.When compared with a pure machinelearning method,the hybrid model is more specific and robust,because it is no longer a black box network.The basic model ensures the main part of the mapping relationship and improves the generalization ability,which can limit the generalization error to the residual level of.The hybrid algorithm has higher precision in calibration,because it can diminish the in fluence of ideal values on the distortions and errors.It divides the mapping relationship into two parts at the beginning,thus avoiding the concealing problem shown in Eq.(16).

5.3D reconstruction

The result of laser scanning is point-cloud data,which needs to be simplified and reconstructed in order to restore the 3D shape of the object.

5.1.Point-cloud reduction

The initial point cloud contains many redundant points;this increases the amount of computation and reduces the efficiency of reconstruction.Therefore,it is necessary to simplify the point cloud before triangulation.We propose a point-cloud simplification method in order to process point-cloud data according to the morphological characteristics of the point cloud.This method has higher processing efficiency and a better streamlining effect.

For the pointcloud thatis obtained by translationalscanning,the density of the point-cloud distribution is larger in the direction of the light bar and smaller in the scanning direction;therefore,there are many redundantpoints in the direction ofthe lightbar,as shown in Fig.7.In order to preserve the feature information of the point clouds,it is necessary to calculate the distance between adjacent points on the stripe.If the distance is greater than the threshold,these points contain more feature information and should be preserved.The rest of the points are sampled randomly according to the density of the point clouds in the scanning direction.

For the point cloud that is obtained by rotational scanning,the point-cloud data are radially distributed around the rotational center.The closer it is to the rotational center,the higher the pointcloud density is and the more redundant points there are,as shown in Fig.8.Therefore,the point-cloud data can be divided into n concentric circle regions around the center of rotation.The radii of the concentric circle are r, and the area of each concentric circle is equal.According to the distribution characteristics of point clouds,the number of points in each ring is proportional to the width of the ring.If the ratio is k,the point-cloud density of the if rst ring is

完善的灌溉管理制度可以加速农业节水灌溉技术的推广,促进农业经济的发展。在灌溉管理制度中,要重视对农业节水灌溉技术的宣传,使更多的农民可以更加了解农业节水灌溉技术,调动农民采用农业节水灌溉技术的积极性。

Fig.7.The translational scanning point cloud.

Fig.8.The rotational scanning point cloud.

According to the density of the point clouds in each concentric ring,we set a simplified threshold in order to simplify the point cloud.Finally,a complete point cloud with uniform distribution and more feature information is obtained.

5.2.Delaunay triangulation

A triangular mesh occupies less storage space and represents better surface fineness;thus,it has become the main means of realizing 3D display in a computer.In general,there are two ways to triangulate 3D point-cloud data: first,directly triangulating 3D points;and second,projecting 3D points onto the 2D plane,using 2D plane triangulation to create meshes.The former way has a large computation and the algorithm is not stable.2D planar triangulation has a good theoretical basis and good mathematical characteristics,but it is only suitable for surfaces that are projected in a certain direction without overlapping.

According to the principle of translational scanning,as shown in Fig.3,the point-cloud data obtained by the translational scanning of line-structured light can actually be regarded as the projection of the object in the x w o w y w plane.Therefore,the translational scanning point cloud represents a surface projected onto the x w o w y w without overlap,which can be directly projected through two dimensions transformation,using the Watson's algorithm for triangulation[24].The Delaunay triangulation process using the Watson's algorithm is as follows:① build a super triangleΔE that contains all the points;②insert a new point from the point set and connect it to the three vertices of the triangleΔE in order to form the initial mesh; ③ insert a new point and find the ‘‘in fluence triangle,”which is the triangle containing the point;④ delete the common edge of the ‘‘in fluence triangle”and connect the new point to the related vertices in order to form a new mesh;⑤repeat③and④until all of the points in the point set are processed.

Because of the characteristics of the revolving body,the rotational scanning point cloud has overlapping problems in any direction.Therefore,point clouds cannot be directly triangulated through 2D projections.Considering the acquisition process of the rotational point cloud,the point-cloud data are obtained by line-structured light projection before tilting and splicing.Therefore,the rotating point cloud can be tilted and expanded according to the scanning position by coordinate transformation.The expanded point cloud has the shape of a linear-structured light projection and can be triangulated by 2D projection.It is necessary to combine the triangular mesh together after the point cloud is triangulated in order to finally obtain the complete subdivision of the rotating point cloud.

The triangulation of the rotational scanning point cloud can be summarized as follows:①divide the rotational point cloud into four regions,A,B,C,and D,and ensure that A,B,C,and D have overlapping boundary points,as shown in Fig.9;②transform the coordinates of each region with the center of rotation and expand the point cloud into the shape before tilting and splicing;③at this time,every area forms a surface that does not overlap the x w o w y w plane itself;④triangulate the point cloud of each region;⑤after the 2D projective triangulation of each region is complete,put the triangular mesh together to form the complete mesh of the original point cloud,according to the overlapping boundary points of the four regions.

6.Experiments and results

Experiments using the Tsai's two-step method,the BPN method,and the hybrid method were conducted in order to demonstrate the validity of the hybrid calibration.Measurement and reconstruction results after calibration were obtained.

6.1.Calibration

6.1.1.Data collection

结合标志盘、标志桶、过球杆、绳梯奥、小跳架、移动小球门等器具训练的俱乐部形式,将会显著提高大学生原有的身体协调性,提高跑动的能力与无球跑动的意识.训练的多样性,将从各个角度刺激这项技能的记忆,有利于大学生足球水平的提高.

The points were collected by placing the stepped gauge on the translation platform with its first tread under the laser.As the world coordinates frame was set based on the physical dimensions of the gauge,the remaining steps were performed automatically through programmatic control.This section introduces the experiment based on the left camera.The images of the treads that were collected in the experiment are shown in Fig.10.A total of 5038 valid samples were collected after image processing;these were used for the calibration of the translation scan by establishing the coordinate transformation.A pair of symmetrical pattern images that were collected in the experiment is shown in Fig.11.Since the interval angle was 15°,a total of 12 pairs of symmetrical images were used for the calibration of the rotation scan.

还真是报应,我在前一秒对那个女孩表示了鄙视之后,下一秒就看到那个和她眉目传情的家伙就是,我的男朋友,秦明。不过已经无所谓,因为下一刻,他就会被我称作,前男友。我在最后一刻还是犯了所有小女人都犯的矫情的毛病——我要和他在我们最初见面的地方说分手。

Fig.9.Dividing and expanding the original point cloud.

Fig.10.Image acquisition of the target.(a)First,(b)second,(c)third,(d)forth,and(e) fifth tread.

6.1.2.Calibration results

Based on the hybrid algorithm,the basic model was worked out using Eq.(21).The compensation network was a three-layer BPN with five hide nodes,which was trained 100 times with a terminal of 10-4.β and O r can be calculated in each pair,with the average taken as the final value.The parameters of the basic model and the network are provided below:

Calibrations were also conducted with the Tsai's two-step method and the pure BPN method as contrasting experiments.The calibration results of the Tsai's method are given below:

Fig.11.Image acquisition of the pattern.(a)θ =0°;(b)θ =180°.

In the pure BPN method,the network was also three layers with five hide nodes.After being trained 100 times with a terminal of 10-4,its parameters were as follows:

6.1.3.Discussion

UPLC-Q-TOF/MS法分析鉴定对叶百部碱在大鼠体内的代谢产物 ………………………………………… 董 巍等(9):1218

The stepped gauge was scanned using different methods,and five equally spaced points were picked up on each tread.In this case,the points on each tread were uniformly distributed along the x axis of the image plane,while the treads were uniformly ordered along the y axis.A reference plane that was 2 mm below the first tread was also scanned;it imaged on the edge of the pixels array and was used to test the generalization ability.The distribution and statistics of the errors are shown in Fig.12 and Table 1.The performances of the networks in the pure BPN method and the hybrid method are shown in Fig.13.For the rotation scan,the endpoints on the pattern were picked out in order to calculate the errors in the rotation scan,as shown in Fig.14 and Table 1.

As shown in Fig.12,the Tsai's method has regular,steady errors.For the whole gauge,the treads close to the middle had smaller errors than those close to the edge.For each tread,the points close to the middle had smaller errors than those close to the edge.Errors in the reference plane were the worst,but still followed this regularity.This distribution is very similar to the distortions,which explains where the errors mainly come from.The root mean square(RMS)errors in the translation scan and rotation scan were 0.030 and 0.056 mm,respectively.The BPN method seems to perform better than the Tsai's method on the treads,even with the irregularly distributed errors.However,on the reference plane,the errors turned out to be much bigger suddenly,which was caused by the poor generalization ability of this method.As a result,the overall RMS of the BPN in the translation scan and rotation scan reached 0.027 and 0.060 mm,respectively.The hybrid method achieved the best performance in this experiment.It has the smallest errors when compared with the Tsai's method and the BPN method.The RMS of the errors was 0.016 and 0.031 mm.The basic model ensures steady errors,even on the reference plane.The separation of ideal values and errors also improves the performance of the network.As shown in Fig.13,for the network in the hybrid method,the mean squared error(MSE)drops 0.0014612 at epoch 19,while that in the pure BPN method is 0.0014651 at epoch 932.The convergence rate of the MSE is much faster in the hybrid method than in the pure BPN method.The dental mold measurement error is required to be less than 0.2 mm,so our measurement method satisfies the accuracy requirements.

Fig.12.Errors in the translation scan.

Table 1 Error statistics.

T.scan:translation scan;R.scan:rotation scan;RMS:root mean square.

Method Maximum error(mm) Minimum error(mm) Mean error(mm) RMS(mm)T.scan R.scan T.scan R.scan T.scan R.scan T.scan R.scan Tsai 0.045 0.086 0.014 0.032 0.030 0.054 0.030 0.056 BPN 0.055 0.077 0.004 0.034 0.023 0.058 0.027 0.060 Hybrid 0.027 0.046 0.005 0.015 0.015 0.029 0.016 0.031

Fig.13.Performance of(a)pure BPN and(b)hybrid BPN.MSE:mean squared error.

Fig.14.Errors in the rotation scan.

6.2.Measurement

Fig.15.A typical dental piece for a translation scan.

Fig.16.A typical dental piece for a rotation scan.

Fig.17.Reconstruction of translation scan.(a)The primary point cloud;(b)point cloud after de-noising and reduction;(c)the result of the Delaunay triangulation;(d)the final 3D reconstruction.

Fig.18.Reconstruction of rotation scan.(a)The primary point cloud;(b)point cloud after de-noising and reduction;(c)the result of the Delaunay triangulation;(d)the final 3D reconstruction.

Typical dental pieces measured by means of a translation scan and rotation scan,respectively,are shown in Figs.15 and 16.The measurement results and reconstruction process are shown in Figs.17 and 18.Fig.17(a)is the primary point cloud with a total of 37 983 points,while Fig.17(b)is the point cloud after de-noising and reduction,with a total number of points that has decreased to 6218.Fig.17(c)shows the result of the Delaunay triangulation.The final 3D reconstruction is shown in Fig.17(d).Fig.18(a)is the primary point cloud,which contains many redundant points.After reduction,the number of points is reduced from 87 458 to 6267,as shown in Fig.18(b).The Delaunay triangulation and the final 3D reconstruction are shown in Fig.18(c)and(d).The results meet the requirements for dental application.

玉皇大帝曾赐给汉人竹片片,让汉人记录他们的历史、言行,也给了傈僳人獐皮,用以写信等。但是,领獐皮的是一个小孩,他想獐皮这样笨重难拿,不如吃了还可以饱肚子。于是,在一块玉米地里偷偷地吃了,回到家里说獐皮被人抢走了,或者在遇到人时说玉帝什么也没给,因此,傈僳无记录之纸,也就不能创造文字了。[注]李永宪、马云喜:《盐边县岩门公社傈僳族调查报告》,编写组:《四川省苗族傈僳族傣族白族满族社会历史调查》,四川省社会科学院出版社,1986年。

7.Conclusions

This paper developed a dual-platform laser scanner and proposed a hybrid calibration method for 3D laser scanning for the 3D reconstruction of dental pieces.The dual-platform scanner has a low cost and is suitable for different dental pieces.The hybrid calibration,which includes an integrative method for data collection and a hybrid algorithm for data processing,achieves convenient operation and high precision.The integrative method is able to collect a substantial number of accurate calibrating points by means of a stepped gauge and a pattern with little human intervention.The hybrid algorithm synthesizes the advantages of the mathematical and machine-learning methods through the combination of a basic model and a compensation network.The calibration experiments verified the excellent performance of the hybrid calibration,which had strong stability and a small degree of errors.Two typical dental pieces were measured in order to demonstrate the validity of the measurement performed using the dual-platform scanner.This method provides an effective way for the 3D reconstruction of dental pieces in clinical teaching.

The dual-platform laser scanner can also be applied to the 3D measurement of objects with irregular surfaces,such as the reconstruction of sculptures and artifacts,the measurement of complex industrial parts,and rapid reverse Engineering combined with 3D printing.However,the dual-platform laser scanner is bulky and not portable.The scanning process is thus limited by the mechanical platform.

Acknowledgements

The authors are grateful for support from the National Science Fund for Excellent Young Scholars(51722509),the National Natural Science Foundation of China(51575440),the National Key R&D Program of China(2017YFB1104700),and the Shaanxi Science and Technology Project(2016GY-011).

Compliance with ethics guidelines

Shuming Yang,Xinyu Shi,Guofeng Zhang,and Changshuo Lv declare that they have no conflict of interest or financial conflicts to disclose.

References

[1]Welk A,Rosin M,Seyer D,Splieth C,Siemer M,Meyer G.German dental faculty attitudes towards computer-assisted learning and their correlation with personal and professional profiles.Eur J Dent Educ 2005;9(3):123-30.

[2]Munera N,Lora GJ,Garcia-Sucerquia J.Evaluation of fringe projection and laser scanning for 3D reconstruction of dental pieces.Dyna 2012;79(171):65-73.

[3]Geng J.Structured-light 3D surface imaging:a tutorial.Adv Opt Photonics 2011;3(2):128-60.

[4]Zhou W,Guo H,Li Q,Hong T.Fine deformation monitoring of ancient building based on terrestrial laser scanning technologies.IOP Conf Ser Earth Environ Sci 2014;17:012166.

[5]Andersen UV,Pedersen DB,Hansen HN,Nielsen JS.In-process 3D geometry reconstruction of objects produced by direct light projection.Int J Adv Manuf Technol 2013;68(1-4):565-73.

[6]Choi S,Kim P,Boutilier R,Kim MY,Lee YJ,Lee H.Development of a high speed laser scanning confocal microscope with an acquisition rate up to 200 frames per second.Opt Express 2013;21(20):23611-8.

[7]Dewar R.Self-generated targets for spatial calibration of structured light optical sectioning sensors with respect to an external coordinate system.Cleveland:Society of Manufacturing Engineers;1988.

[8]Duan FJ,Liu FM,Ye SH.A new accurate method for the calibration of line structured light sensor.Chin J Sci Instrum 2000;21:108-13.Chinese.

[9]Huynh DQ,Owens RA,Hartmann PE.Calibration a structured light stripe system:a novel approach.Int J Comput Vis 1999;33(1):73-86.

[10]Zhou F,Zhang G.Complete calibration of a structured light stripe vision sensor through planar target of unknown orientations.Image Vis Comput 2005;23(1):59-67.

[11]Sun Q,Hou Y,Tan Q,Li G.A flexible calibration method using the planar target with a square pattern for line structured light vision system.PLoS One 2014;9(9):e106911.

[12]Xie Z,Wang X,Chi S.Simultaneous calibration of the intrinsic and extrinsic parameters of structured-light sensors.Opt Lasers Eng 2014;58:9-18.

[13]Li J,Chen M,Jin X,Chen Y,Dai Z,Ou Z,et al.Calibration of a multiple axes 3D laser scanning system consisting of robot,portable laser scanner and turntable.Optik 2011;122(4):324-9.

[14]Li P,Zhang W,Xiong X.A fast approach for calibrating 3D coordinate measuring system rotation axis based on line-structure light.Microcomput Appl 2015;34:73-5.Chinese.

[15]Wu Q,Li J,Su X,Hui B.An approach for calibration rotor position of threedimensional measurement system for line-structure light.Chin J Lasers 2008;35(8):1224-7.Chinese.

[16]Chang M,Tai WC.360-deg profile noncontact measurement using a neural network.Opt Eng 1995;34(12):3572-7.

[17]Dipanda A,Woo S,Marzani F,Bilbault JM.3D shape reconstruction in an active stereo vision system using genetic algorithms.Patt Recog 2003;36(9):2143-59.

[18]Zhao Y,Ren H,Xu K,Hu J.Method for calibrating intrinsic camera parameters using orthogonal vanishing points.Opt Eng 2016;55(8):084106.

[19]Tsai RY.A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses.IEEE J Robot Autom 1987;3(4):323-44.

[20]Zhang Z.A flexible new technique for camera calibration.IEEE Trans Pattern Anal Mach Intell 2000;22(11):1330-4.

[21]Li XW,Cho SJ,Kim ST.Combined use of BP neural network and computational integral imaging reconstruction for optical multiple-image security.Opt Commun 2014;315(6):147-58.

[22]Wei P,Cheng C,Liu T.A photonic transducer-based optical current sensor using back-propagation neural network.IEEE Photonics Technol Lett 2016;28(14):1513-6.

[23]Zhang Y,Liu W,Li X,Yang F,Gao P,Jia Z.Accuracy improvement in laser stripe extraction for large-scale triangulation scanning measurement system.Opt Eng 2015;54(10):105108.

[24]Watson DF.Computing the n-dimensional Delaunay tessellation with applications to Voronoi polytopes.Comput J 1981;24(2):167-72.

Shuming Yang,Xinyu Shi,Guofeng Zhang,Changshuo Lv
《Engineering》 2018年第6期
《Engineering》2018年第6期文献
Engineering Fronts in 2018 作者:Fang Cai,Jiu-Ming Ji,Zhi-Qiang Jiang,Zhi-Rui Mu,Xiang Wu,Wen-Jiang Zheng,Wei-Xing Zhou,Shan-Tung Tu,Xuhong Qian

服务严谨可靠 7×14小时在线支持 支持宝特邀商家 不满意退款

本站非杂志社官网,上千家国家级期刊、省级期刊、北大核心、南大核心、专业的职称论文发表网站。
职称论文发表、杂志论文发表、期刊征稿、期刊投稿,论文发表指导正规机构。是您首选最可靠,最快速的期刊论文发表网站。
免责声明:本网站部分资源、信息来源于网络,完全免费共享,仅供学习和研究使用,版权和著作权归原作者所有
如有不愿意被转载的情况,请通知我们删除已转载的信息 粤ICP备2023046998号