Study of a transferring system for measurements in aircraft assembly

Shuanggao Li (College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China)
Zhichao Huang (College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China)
Qi Zeng (College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China)
Xiang Huang (College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China)

Journal of Intelligent Manufacturing and Special Equipment

ISSN: 2633-6596

Article publication date: 13 April 2022

Issue publication date: 10 May 2022

633

Abstract

Purpose

Aircraft assembly is the crucial part of aircraft manufacturing, and to meet the high-precision and high-efficiency requirements, cooperative measurement consisting of multiple measurement instruments and automatic assisted devices is being adopted. To achieve the complete data of all assembly features, measurement devices need to be placed at different positions, and the flexible and efficient transfer relies on Automated Guided Vehicles (AGVs) and robots in the large-size space and close range. This paper aims to improve the automatic station transfer in accuracy and flexibility.

Design/methodology/approach

A transferring system with Light Detection and Ranging (LiDAR) and markers is established. The map coupling for navigation is optimized. Markers are distributed according to the accumulated uncertainties. The path planning method applied to the collaborative measurement is proposed for better accuracy. The motion planning method is optimized for better positioning accuracy.

Findings

A transferring system is constructed and the system is verified in the laboratory. Experimental results show that the proposed system effectively improves positioning accuracy and efficiency, which improves the station transfer for the cooperative measurement.

Originality/value

A Transferring system for collaborative measurement is proposed. The optimized navigation method extends the application of visual markers. With this system, AGV is capable of the cooperative measurement of large aircraft structural parts.

Keywords

Citation

Li, S., Huang, Z., Zeng, Q. and Huang, X. (2022), "Study of a transferring system for measurements in aircraft assembly", Journal of Intelligent Manufacturing and Special Equipment, Vol. 3 No. 1, pp. 31-47. https://doi.org/10.1108/JIMSE-01-2022-0001

Publisher

:

Emerald Publishing Limited

Copyright © 2022, Shuanggao Li, Zhichao Huang, Qi Zeng and Xiang Huang

License

Published in Journal of Intelligent Manufacturing and Special Equipment. Published by Emerald Publishing Limited. This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and noncommercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence may be seen at http://creativecommons.org/licences/by/4.0/legalcode


1. Introduction

Aircraft assembly is one crucial part of aircraft manufacturing (Mei and Maropoulos, 2014), and to meet the high-precision and high-efficiency requirements, cooperative measurement consisting of multiple measurement instruments and automatic assisted devices is being adopted (Flynn and Miller, 2019). The data measured at a single position is limited and to achieve more data of all assembly features, measurement instruments need to be placed at different positions (Deng et al., 2018). The flexible and efficient transfer relies on Automated Guided Vehicles (AGVs) and robots in the large-size space and close range, respectively. Manual handling of measuring instruments is inefficient for station transfer and unreliable in terms of accuracy, which will eventually reduce the measurement efficiency and accuracy (Deng et al., 2018). With automatic station transfer, the efficiency of alignment can be improved as well (Zeng et al., 2020a; Liu et al., 2017; Mei and Maropoulos, 2014). Hence, it is of great significance to research on the automatic station transfer for the cooperative measurement in the field of aircraft manufacturing.

Many navigation methods applied for automatic station transfer have been developed in recent years, which could be divided into three main categories according to the ranging devices (Ryck et al., 2020; Andrea, 2012; Andreasson, 2015): (1) LiDAR (Light Detection and Ranging)-sensor-based type; (2) vision-sensor-based type; and (3) hybrid-sensors-based type. In those LiDAR-sensor-based methods, the navigation map is usually constructed with Simultaneous Localization and Mapping (SLAM), and it is superior in the performance of flexible navigation and active obstacle avoidance (Hess et al., 2016; Ramasamy et al., 2016). However, the transfer only relying on LiDAR is not accurate enough for cooperative measurement since positioning accuracy requirement in the efficient pre-alignment is almost 5 mm (Wu and Du, 2018). Speaking of the vision-based measurement, there are two main kinds: one kind is to build a map with the help of Visual Simultaneous Localization and Mapping (VSLAM) (Mur-Artal et al., 2015; Mur-Artal and Tardos, 2017), and the other kind is to recognize the visual markers. VSLAM has an advantage of map construction and perception of large-scale spaces while the visual markers based methods are more accurate in positioning. QR (Quick Response) code, AR Tag, ArUco Marker (Garrido-Jurado, 2014), April Tag (Olson, 2011; Wang and Olson, 2016) and so on are the most common visual markers, and among them, April Tag (Xing et al., 2018) is outstanding for easier identification and higher positioning accuracy (Krogius et al., 2019). With markers as reference, the positioning is more convenient, and less or no interference of ambient light will happen. In view of this, this way is more applicable for transfer in the field of aircraft manufacturing. Wang et al. proposed a mobile robotic measurement system for large-scale complex components based on the visual markers (Wang et al., 2021). But as Fiala et al. pointed out, the high positioning accuracy is limited to the periphery of markers, and for flexible transfer in the entire map, markers need to be combined with other methods (Fiala, 2015). Consequently, the hybrid method is developed to fuse information from different sensing devices, especially the hybrid of LiDAR and markers.

In the research of hybrid methods, Subramanian et al. effectively optimized the obstacle avoidance of Unmanned Aerial Vehicle UAV by the hybrid of LiDAR and visual navigation methods (Ramasamy et al., 2016). Gao et al. improved the accuracy and flexibility, and the core is the occupancy map with markers integrated into it (Gao et al., 2016). In recent studies, there are basically two main difficulties in this hybrid positioning system. The coupling accuracy is the prior factor for positioning accuracy, it is restricted by the ranging limitation of LiDAR. Besides, the position can be accurately achieved by measuring the close and fixed markers, and once the AGV moves away from the marker, the positioning accuracy decreases rapidly. So does the flexibility.

In terms of the coupling, it is optimized by the Adaptive Monte Carlo Localization (AMCL) in usual (Röwekämper et al., 2012). For further optimization, Kudriashov et al. incorporated the EKF (extended Kalman filter) filtering into AMCL (Kudriashov et al., 2019). The scene for the cooperative measurement is rarely changed and the measurement of AGV's positions for AMCL can be more accurate. The laser tracker is the high-precision measurement instruments and is indispensable in the cooperative measurement, which can be adapted for the measurement of AGV. The coupling can be improved by the more accurate positions of AGV. Based on this, the method of map construction is proposed and the conversion matrix of the coupling can be calculated. For the deficiency in flexibility, Zeng et al. fixed QR codes in the circular route and then the positions can be calibrated periodically (Zeng et al., 2019). Wang et al. arranged markers in a certain density to calibrate the positioning (Wang et al., 2021). The transfer in the measurement area demands high positioning accuracy, and quantitative analysis of various possible deviations is the premise of marker's layout. In view of this, the proposed method quantifies the deviations, assumes and verifies the relationship between the interval of markers and the various accumulative deviations. Based on this relationship, the layout of markers is reasonably estimated and applied.

In addition, the navigation method is changed adaptively as well. The entire navigation is segmented into several segments to recognize the markers, and in case of the damage of measurement instruments, the cost of path planning takes the changes of direction into consideration. Then the A*-heuristic algorithm (A*) is adapted accordingly. The measurement accuracy of the odometry decreases with distance, and due to the calibration of markers, the distance away from makers in the proposed map is very short. Hence, odometry and markers are adapted for the adjustment as accurate references. Together with the prearrangement and navigation method, the navigation system via LiDAR and markers is constructed for cooperative measurement in the field of aircraft manufacturing.

The rest of the paper proceeds in the following order. Section 2 briefly describes the structure of the system. Section 3 shows the method of map coupling and layout of markers. Section 4 explains the optimization of navigation methods in detail. The experiments of the self-positioning and navigation methods are evaluated and discussed in Section 5. Then, the conclusions and the future work are shown in Section 6.

2. System structure

The transferring system can be applied to the wing and fuselage assembly as shown in Plate 1. The proposed navigation system consists of the following equipment (Qin et al., 2016):

  1. AGV with mecanum-wheels for flexible and accurate station transfer;

  2. LiDAR on board for map construction and obstacle avoidance;

  3. A camera on board for marker recognition and position calibration;

  4. Markers fixed on the ground for position calibration and map construction, which are also the core of path planning;

  5. A laser tracker for the assistance of map construction and verification of the accuracy in positioning.

The actual scene is scanned by LiDAR and the occupancy grid map is constructed with SLAM. The coordinates of markers and AGV are measured to optimize the coupling by the laser tracker with higher positioning accuracy. When the conversion matrix of two maps is decoupled, markers can be coupled into the grid map accordingly. For better path planning, segmented navigation method is adapted for periodic calibration with markers. A* is optimized to select the path with the least cost and minimize the changes in direction to improve the reliability during the station transfer. Boundary marker is the marker closest to the target station, which is chosen to improve the final positioning accuracy. The procedure of the proposed navigation system can be simplified as Figure 1.

3. Map construction

During the map coupling, the relative positions of AGVs are usually estimated by the odometry, which can be optimized by the laser tracker. And there is a problem that the target ball cannot locate the center of AGV.

Aiming at the problem, a fitting circle measurement method is proposed. The geometric center of Spherically Mounted Retroreflectors (SMRs) does not coincide with the center of AGV, but the relative positions of SMRs are fixed. When AGV rotates, the geometric center of SMRs is distributed in a circle around the geometric center of AGV as shown in Figure 2. AGVs rotate multiple times to calibrate the deviation between the center of SMRs and the center of AGV, where pRjk denotes the center of SMRs and NR denotes the times of rotation.

The center point set is obtained through rotation, and it can be fitted to a circle with Pmid as the center and rmid as the radius. Therefore, the Total Least-Squares (TLS) equation (Coope, 1993), the geometric center of SMRs can be constructed. The problem of determining the circle of best fit, in a TLS scene, to a set of data points PRjRn,j=1,2,,NR, is a special case (n = 2) of the following TLS problem: Determining values of Pmid and rmid which solve the problem:

(1)minPmid,rj=1NR{fj(Pmid,rmid)}2
where fj(Pmid,rmid) is the distance of the point PRj from the fitted circle,
(2)fj(Pmid,rmid)=rmidPmidPRj2

As shown in Plate 2, a right-hand Cartesian coordinate system is established. During the coupling, Np scattered stations are arranged for measurement. pi equals to Pmid at each station. X={x1,x2,,xNp} denotes the positions of AGV in the occupancy grid map (Vasiljevic et al., 2016).

The Iterative Closest Point (ICP) algorithm matching method is used to minimize the coupling error function E(R,t) of the two coordinate systems (Arun, 1987). Decoupling the two coordinate systems of actual scene and grid map and the rotation matrix R and translation vector t can be calculated.

Markers measured by the laser tracker are, M={m0,m1,,mNbq}, where Nbq denotes the number of markers. A denotes the coordinates of markers in the occupancy grid map and it can be obtained by solving the following equation:

(3)A=RM+t

Uncertainties are closely related to positioning accuracy and they are distributed in the following parts: measurement uncertainty from laser tracker σLTS (Zeng et al., 2020b), coupling uncertainty σT, motion uncertainty σm, uncertainty of marker recognition σc and the positioning error of AGV σ (Motai and Kosaka, 2008). The functional relationship between uncertainties and positioning accuracy are calculated and verified by the simulation. σT denotes the coupling uncertainty, and it can be calculated according to equation (3).

To figure out the functional relationship, uncertainties are measured and recorded in different distances respectively. The data are fitted with different functions and the function image is shown in Figure 3. The safety margin coefficient C is designed to leave a margin for uncertainty analysis. The safety margin coefficient should be 1 when the uncertainties are absolutely correct. For the reliability of the equation, the measurement data are calculated under different coefficients and a completely linear distribution. And when C = 1, the calculated result is closer to the actual distribution. In this case, C is slightly greater than 1.

(4)σ=σLTS2+σT2+σc2+Cσm

According to equation (5), the arrangement interval of markers d can be derived. The applicable interval should ensure that AGV can accurately identify the next adjacent marker after identifying one marker at least.

(5)d=2(σσLTS2+σT2+σc2)Cσx2+σy2+dTagdFOV
where dTag denotes the size of markers and dFov denotes the square field of view.

Each interval needs to be less than d, but not to be strictly the same. Therefore, markers can be arranged and coupled into both actual scene and grid map, and the map for transferring is constructed.

Markers are easily contaminated and damaged and the arrangement of markers is time-consuming and troublesome, which are the limitations of the proposed marker based positioning method in actual measurement. Therefore, markers need to be checked and replaced regularly. Besides, the number of arranged markers can be reduced by planning the measurement area and other area in advance. As shown in Figure 4, 36 markers rather than 56 markers need deploying after the pre-planning.

4. Navigation method

Since the prearrangement of the system is completed, the navigation method is optimized accordingly. The navigation from the initial station to the boundary marker and from the boundary marker to the target station is segmented as rough navigation and precise navigation respectively (see Figure 5).

The rough navigation is segmented into several segments and each segment is able to identify markers for position calibration, the difficulty of which is the accumulated errors.

Few markers are better for the efficiency, and the selection method can be obtained.

(6)σgNσLTS2+σT2+σc2+Cσm

The set of markers is denoted as A={A1,A2,A3,,ANtag}, where Ntag denotes the sum of markers and A denotes the set of markers. The uncertainty from the initial point to the boundary marker is summarized as σg, where g denotes the index of the boundary marker.

N denotes the number of segments and can be obtained as follows:

(7)N=σgσLTS2+σT2+σc2+Cσm

The reference Manhattan distance of each segment which denotes dSeg can be calculated accordingly.

(8)dSeg=d(TStart,Ag)N

Interval of these markers closer to the reference distance and markers closer to the target station are selected as the segmented markers. The relationship of segmented markers can be expressed as follows:

(9)ij={d(TStart,Aij)d(TStart,Aij1)dSegmind(TStart,Aij)+d(Aij,TGoal)=d(TStart,TGoal)

TGoal denotes the position of the target station and i1,i2,...,iN denotes the index of selected markers. Especially, iN=g.

During the navigation, changes in direction (Censi et al., 2013) will increase the count error of encoder and then reduce the accuracy of motion control. And routes with multiple turns are not allowed in the real measurement, because it will complicate the arrangement of measurement instruments.

(10)g(n)={g(n1)+ksame(g(n)g(n1)),Dn1,n=Dn2,n1g(n1)+kdiff(g(n)g(n1)),Dn1,nDn2,n1f(n)=g(n)+h(n)

To reduce the cost of changes in direction, the expansion direction of node denoted as Dn1,n is introduced. When the expansion direction of the node is the same as the previous one, the Manhattan distance of the expansion node is reduced to ksame times of the actual distance. When different, it will increase kdiff times.

The final positioning accuracy of AGV is more crucial for measurement. Generally, dynamic window approach (DWA) and virtual force field and other motion planning methods concentrate on the obstacle avoidance (Ryck et al., 2020) rather than the final positioning. The positions of AGV are calibrated by boundary markers and then AGV with odometry (Kallasi et al., 2017) is capable of high feedback accuracy at a short distance.

The DWA is optimized as follows.

(11)G(v,w)=α·angle(v,w)+β·dist(v,w)+γ·vel(v,w)+η·dtar(v,w)

In the above equation, taking into account the angle adjustment after the station, the angle evaluation function is optimized and adjusted.

(12)angle(v,w)={1θπ,dtar(v,w)>dM arg inθθtarπ,dtar(v,w)dM arg in

The remaining distance function is added to encourage the approaching. In the equation, dtar is the distance between the current position and the goal, dtar0 is the distance between the calibrated position with markers and the goal and dsam is the sampling distance (see Figure 6).

(13)dtar(v,w)=cos(dtar+dsamdtar0+dsam)

The speed is reduced as the goal gets closer.

(14)vel(v,w)=vvmax,vsin(dtar+dsamdtar0+dsam)vmax

5. Experiment

Markers are applied to improve the accuracy of the occupancy grid map, optimize the path planning method and calculate the adjustment with high accuracy, which plays a crucial role in the proposed navigation system. It is indispensable to verify the self-positioning accuracy of recognizing markers.

The laser tracker is a high-precision measuring device and it can be applied as ground truth for accuracy verification. And then, the accuracy of self-positioning can be verified with the markers. To verify the accuracy and efficiency of the proposed navigation method, several methods are experimented for comparison.

5.1 Accuracy of self-positioning

The process of the self-positioning is that AGV recognizes the marker and calculate the position of the AGV. The deviation of the visual self-positioning σcam has a vital effect on the positioning accuracy. In order to verify the reliability of the self-localization algorithm, the proposed marker based positioning method is compared with AMCL and NAV350 methods which are widely used in factory. As shown in Plate 3, the experimental equipment consists of AGV (repeatability: 0.1 mm), camera (type: MER2-503-36U3M/C-L, accuracy: 100l p/mm), markers (type: April Tag, size: 50 × 50 mm), LiDAR (type: Hokuyo UST-10LX, accuracy: ±40 mm), NAV350 laser scanner (accuracy: ±4 mm), laser tracker and the matching T-Probe (type: Leica AT901, accuracy: ±10 μm+5 μm/m).

The proposed positioning method is to achieve the positions of markers by the T-Probe and then to calculate the positions of AGV with cameras. The AMCL method is to build an occupancy grid map with SLAM and then to calculate the positions with AMCL algorithm. NAV350 obtains its precise position through the reflector. The positioning accuracy of different methods is compared with the reference, which is the position of AGV obtained by the laser tracker. Deviations will be negative when AGV has not reached the theoretical position, otherwise it will be positive. The three positioning methods are verified 20 times in each of the four markers and deviations with reference can be processed into the distributions of different directions as shown in Plate 3 and Table 1, where μself denotes the average deviation and σself denotes the standard deviation. dr represents the magnitude of the deviation, which does not follow the normal due to the loss of direction.

Figure 7 shows the deviations of three methods in direction x and y. The average positioning accuracy of the AMCL based algorithm is about ±52.572 mm, the accuracy of which is too large for the measurement. The average positioning accuracy of the proposed marker based method at four markers is ±1.139 mm and the widely used expensive Sick NAV350 is about ±4.367 mm, which shows that the proposed marker based methods is superior in positioning. Main reason for the difference in positioning is the difference of the reference. The references of three methods are markers, laser cloud points and reflectors. Combined with reflectors, NAV 350 uses the TOF (time of flight) method to directly measure the distance, which is more reliable than point clouds. The feature of markers is more obvious and easier than reflectors to be calibrated, so the positioning accuracy is highest among the three. In general, the proposed marker-based positioning method is more suitable for the cooperative measurement.

5.2 Accuracy and efficiency of navigation methods

The proposed navigation system makes full use of markers for cooperative measurement. As shown in Plate 4, the verification prototype consists of AGV, LiDAR (type: Hokuyo UST-10LX, accuracy: ±4 mm), camera, laser tracker, April Tags at different intervals and three different routes and the experiment is carried out on the three routes. As shown in Figure 8, the cost of Route A is the least which is preferred by our path planning method and Route C is secondly preferred. Route B with multiple turns is selected to compare with Route A and Route C for the importance of reducing changes in direction. The proposed segmented navigation method is compared with the uniform distribution method utilized by Wang and the method without segmentation (Wang et al., 2021).

The proposed method and Wang both segment the navigation into several segments. The difference is that the segmentation by Wang is based on multiple markers with same intervals and the interval is selected by estimation and experience. The proposed method selects the boundary marker first, and then calculates the specific navigation interval with proposed equations in advance. In order to fully compare with the uniform distribution method, several intervals of segmentations are designed. When the interval is five markers, AGV cannot guarantee recognizing the segment marker because of the accumulated deviation. To simplify the description, the different segmentation methods are denoted as several cases. Case I is that AGV moves without the help of markers. Case Ⅱ, case III, case IV and case V are the uniform distribution from every one marker to every four markers, respectively. Case VI is the segmentation with the proposed method. At each route of the three paths, the three different navigation methods are all conducted and the average measurement results are shown in Figure 9 and Table 2. In Figure 9, the colorful grids represent the position of the measurement, and the color denotes the deviation. The distribution of deviations is shown in Table 2 where μp denotes the mean deviation, σp denotes the standard deviation and t denotes the cost time of navigation.

The average positioning accuracy and cost time of three routes are 7.6 mm, 8.4 mm, 8.0 mm and 150 s, 172.8 s, 154.8 s, respectively. The result shows that the cost time of Route A is 4.8 s less on average than on Route C, while the average positioning accuracy is 5.3% higher than that of Route C. The main reason for the difference is the steering of AGV at the first marker. Comparing with Route A, Route B with more turnings takes 15.2% more time and the accuracy of Route B is also 0.8 mm lower, which can prove that changes in direction do have an influence on the deviations and cost time.

The result of six cases is compared for the verification of segmentation methods. The cost time of case I is 13.3% shorter than other cases on average, while the positioning accuracy drops by 32.6 mm on average. The comparison shows that although the segmented navigation methods with markers cause a decrease in efficiency, it will significantly improve the positioning accuracy. The average positioning accuracy and cost time of cases with uniform distribution method are 1.8 mm, 2.2 mm, 1.9 mm, 4.3 mm and 180 s, 169.7 s, 160.3 s, 149.3 s, respectively. In general, the smaller the interval, the higher the positioning accuracy and the more time it takes. However, the comparison of case II, case III and case IV shows that the positioning accuracy is optimized no more than 4% while the cost time is increased by 12.3%. The variance becomes smaller, but the positioning accuracy has not improved significantly as the interval shrinks. The reason can be derived from the comparison with case V and case VI. Segmentation of case V and case VI is similar except the difference of the boundary marker. Case VI takes 2.3% more time while the final positioning accuracy increases by 48.8%. Boundary marker is the marker closest to the target station and it can reduce the cumulative error of odometry effectively. The boundary marker is all covered by case II, case III and case IV, so the positioning accuracy is not much different. Comparing with case II and case VI, the positioning accuracy is almost the same and enough for the measurement requirements of ±5 mm, but the efficiency has increased by more than 17%. Synthetically, the proposed navigation method is relatively superior in the comparison and well applied for the cooperative measurement with high accuracy and efficiency.

6. Conclusions

This paper proposes a marker based high-precision LiDAR navigation system for cooperative measurement. The coupling method is improved by designing a coupling method and the interval of markers is calculated based on the uncertainty analysis. The proposed navigation method optimizes the path planning method with segmentation and improved A*. The precise adjustment is completed with odometry near the boundary marker. The accuracy of self-positioning is verified with different positioning methods. The proposed navigation method is verified with several methods in our experimental prototype. In general, the proposed navigation system is efficient and flexible for the accurate aircraft cooperative measurement.

Future work will focus on the following areas:

  1. Applying the marker-based algorithms to the field of VSLAM;

  2. Adaptively improving the system for more aircraft assembly needs.

Figures

An application of wing and fuselage assembly. Fuselage, wing and other measurement instruments are transferred by AGV, and two coordinate systems are constructed for navigation

Plate 1

An application of wing and fuselage assembly. Fuselage, wing and other measurement instruments are transferred by AGV, and two coordinate systems are constructed for navigation

The proposed navigation system consists of map construction and navigation method and map construction is the prearrangement for navigation method

Figure 1

The proposed navigation system consists of map construction and navigation method and map construction is the prearrangement for navigation method

The fitting circle measurement method is proposed for figuring out the geometric center of AGV

Figure 2

The fitting circle measurement method is proposed for figuring out the geometric center of AGV

The positions of AGV in the coordinate system of scene are measured in sequence by the laser tracker. The positions of AGV in the coordinate system of grid map are measured by LiDAR accordingly

Plate 2

The positions of AGV in the coordinate system of scene are measured in sequence by the laser tracker. The positions of AGV in the coordinate system of grid map are measured by LiDAR accordingly

Functional relationships between uncertainties and movement distances are simulated and the results of simulation are distinguished by different colors

Figure 3

Functional relationships between uncertainties and movement distances are simulated and the results of simulation are distinguished by different colors

The whole scene is divided into measurement area and other areas, as shown in (a) and (b) respectively

Figure 4

The whole scene is divided into measurement area and other areas, as shown in (a) and (b) respectively

Process from position A to position B is segmented into segment selection, rough navigation and precise navigation

Figure 5

Process from position A to position B is segmented into segment selection, rough navigation and precise navigation

Sampling space of DWA algorithm

Figure 6

Sampling space of DWA algorithm

Verification of self-positioning is carried out with marker, AMCL with LiDAR and NAV 350

Plate 3

Verification of self-positioning is carried out with marker, AMCL with LiDAR and NAV 350

Distributions of deviations in x and y are compared with three different methods

Figure 7

Distributions of deviations in x and y are compared with three different methods

Experimental verification prototype is constructed in the laboratory and the experiments are conducted

Plate 4

Experimental verification prototype is constructed in the laboratory and the experiments are conducted

The cost of Route A and Route C in path planning is shown and the difference is the cost chosen in the first search

Figure 8

The cost of Route A and Route C in path planning is shown and the difference is the cost chosen in the first search

Deviations with different segmentation methods: (a) to (f) are experiments from I to VI

Figure 9

Deviations with different segmentation methods: (a) to (f) are experiments from I to VI

The deviations of the positions acquired by self-positioning and the laser tracker

NoMarker based positioning methodAMCL positioning methodNAV350 positioning method
dx/mmdy/mmdr/mmdx/mmdy/mmdr/mmdx/mmdy/mmdr/mm
10.2320.3530.42214.3975.06615.263−0.0420.0110.043
20.2980.3420.4530.552−6.4406.463−0.139−0.0890.165
30.1390.1340.19318.43313.41022.7940.0861.9791.981
4−0.3600.1940.40931.40717.21035.8130.4440.9511.050
5−0.3840.0740.391−0.41613.67013.676−0.4090.5790.709
80−0.249−0.3050.3943.6392.0684.1860.1060.1250.164
μself−0.0060.058\2.0693.335\0.1280.040\
σself0.2820.254\12.92311.836\0.9891.068\
±3σself0.8460.7621.13938.76935.50852.5722.9673.2044.367

Average deviation distribution of different navigation methods

CaseIIIIIIIVVVI
RouteABCABCABCABCABCABC
σ (mm)33.337.936.81.62.11.72.12.42.01.91.82.15.14.13.81.82.11.7
μp (mm)16.820.318.51.52.21.81.02.31.71.02.72.54.14.73.83.14.43.2
σp (mm)11.213.112.41.11.51.31.62.11.21.61.71.52.53.63.02.73.83.4
t (s)133158139173188179161182166150176155140165143143168147

References

Andrea, R.D. (2012), “A revolution in the warehouse: a retrospective on kiva systems and the grand challenges ahead”, Automation Science and Engineering, Vol. 9 No. 4, pp. 638-639.

Andreasson, H. (2015), “Autonomous transport vehicles: where we are and what is missing”, Robotics and Automation Magazine IEEE, Vol. 22 No. 1, pp. 64-75.

Arun, K.S. (1987), “Least-squares fitting of two 3-D point sets”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 9 No. 5, pp. 698-700.

Censi, A., Franchi, A., Marchionni, L. and Oriolo, G. (2013), “Simultaneous calibration of odometry and sensor parameters for mobile robots”, IEEE Transactions on Robotics, Vol. 29 No. 2, pp. 475-492.

Coope, I.D. (1993), “Circle fitting by linear and nonlinear least squares”, Journal of Optimization Theory and Applications, Vol. 76 No. 2, pp. 381-388.

Deng, Z., Li, S. and Huang, X. (2018), “A flexible and cost-effective compensation method for leveling using large-scale coordinate measuring machines and its application in aircraft digital assembly”, Measurement Science and Technology, Vol. 29 No. 6, 065904, p. 15.

Fiala, M. (2015), “ARTag, a fiducial marker system using digital techniques”, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2, pp. 590-596.

Flynn, R. and Miller, C. (2019), “11 Reasons to use automated metrology”, SAE Technical Paper 2019-01-1369. doi: 10.4271/2019-01-1369.

Gao, X., Wang, J. and Chen, W. (2016), “Land-mark placement for reliable localization of automatic guided vehicle in warehouse environment”, IEEE International Conference on Robotics and Biomimetics IEEE.

Garrido-Jurado, S. (2014), “Automatic generation and detection of highly reliable fiducial markers under occlusion”, Pattern Recognition, Vol. 47 No. 6, pp. 2280-2292.

Hess, W., Kohler, D., Rapp, H. and Andor, D. (2016), “Real-time loop closure in 2D LIDAR SLAM”, IEEE International Conference on Robotics and Automation, pp. 1271-1278.

Kallasi, F., Rizzini, D.L., Oleari, F., Magnani, M. and Caselli, S. (2017), “A novel calibration method for industrial AGVs”, Robotics and Autonomous Systems, Vol. 94, pp. 75-88.

Krogius, M., Haggenmiller, A. and Olson, E. (2019), “Flexible layouts for fiducial Tags”, IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1898-1903.

Kudriashov, A., Buratowski, T. and Giergiel, M. (2019), “Hybrid AMCL-EKF filtering for SLAM-based pose estimation in rough terrain”, Mechanisms and Machine Science, Vol. 73, pp. 2819-2828.

Liu, H., Zhu, W. and Ke, Y. (2017), “Pose alignment of aircraft structures with distance sensors and CCD cameras”, Robotics and Computer Integrated Manufacturing, Vol. 48, pp. 30-38.

Mei, Z. and Maropoulos, P.G. (2014), “Review of the application of flexible, measurement-assisted assembly technology in aircraft manufacturing”, Proceedings of the Institution of Mechanical Engineers Part B Journal of Engineering Manufacture, Vol. 228 No. 10, pp. 1185-1197.

Motai, Y. and Kosaka, A. (2008), “Hand-eye calibration applied to viewpoint selection for robotic vision”, IEEE Transactions on Industrial Electronics, Vol. 55 No. 10, pp. 3731-3741.

Mur-Artal, R., Montiel, J.M.M. and Tados, J.D. (2015), “Orb-slam: a versatile and accurate monocular slam system”, IEEE Transactions on Robotics, Vol. 31 No. 5, pp. 1147-1163.

Mur-Artal, R. and Tardos, J.D. (2017), “Orb-slam2: an open-source slam system for monocular, stereo and rgb-d cameras”, IEEE Transactions on Robotics, Vol. 33 No. 5, pp. 1255-1262.

Olson, E. (2011), “AprilTag: a robust and flexible visual fiducial system”, IEEE International Conference on Robotics and Automation, pp. 3400-3407.

Qin, Z., Peng, W., Jia, S., Lu, J. and Hong, Q. (2016), “Precise robotic assembly for large-scale objects based on automatic guidance and alignment”, IEEE Transactions on Instrumentation and Measurement, Vol. 65 No. 6, pp. 1398-1411.

Ramasamy, S., Sabatini, R., Gardi, A. and Liu, J. (2016), “LIDAR obstacle warning and avoidance system for unmanned aerial vehicle sense-and-avoid”, Aerospace Science and Technology, Vol. 55, pp. 344-358.

Röwekämper, J., Sprunk, C., Tipaldi, G.D., Stachniss, C. and Burgard, W. (2012), “On the position accuracy of mobile robot localization based on particle filters combined with scan matching”, IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3158-3164, doi: 10.1109/IROS.2012.6385988.

Ryck, M.D., Versteyhe, M. and Debrouwere, F. (2020), “Automated guided vehicle systems, state-of-the-art control algorithms and techniques”, Journal of Manufacturing Systems, Vol. 54, pp. 152-173.

Vasiljevic, G., Miklic, D., Draganjac, I. and Kovacic, Z. (2016), “High-accuracy vehicle localization for autonomous warehousing”, Robotics and Computer Integrated Manufacturing, Vol. 42, pp. 1-16.

Wang, J. and Olson, E. (2016), “AprilTag 2: efficient and robust fiducial detection”, IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4193-4198.

Wang, J., Tao, B., Gong, Z., Yu, S. and Yin, Z. (2021), “A mobile robotic measurement system for large-scale complex components based on optical scanning and visual tracking”, Robotics and Computer-Integrated Manufacturing, Vol. 67, p. 67, doi: 10.1016/j.rcim.2020.102010.

Wu, D. and Du, F. (2018), “A parallel ranging-based relative position and orientation measurement method for large-volume components”, Journal of Sensors, Vol. 3, pp. 1-11.

Xing, B., Zhu, Q., Pan, F. and Feng, X. (2018), “Marker-based multi-sensor fusion indoor localization system for micro air vehicles”, Sensors, Vol. 18 No. 6, pp. 1706-1725.

Zeng, P., Wu, F., Zhi, T., Xiao, L. and Zhu, S. (2019), “Research on automatic tool delivery for CNC workshop of aircraft equipment manufacturing”, Journal of Physics: Conference Series, p. 1215, 012007, doi: 10.1088/1742-6596/1215/1/012007.

Zeng, Q., Li, S., Deng, Z. and Huang, X. (2020a), “An error similarity-based error-compensation method for measurement in the non-uniform temperature field”, Measurement Science and Technology, Vol. 31 No. 8, 085008.

Zeng, Q., Huang, X., Li, S.G. and Deng, Z.P. (2020b), “High-efficiency posture pre-alignment method for large component assembly via iGPS and laser ranging”, IEEE Transactions on Instrumentation and Measurement, Vol. 69 No. 8, pp. 5497-5510.

Acknowledgements

This research was supported by the Defense Industrial Technology Development Program (No. JCKY2018205A001). The authors declare no conflicts of interest.

Corresponding author

Xiang Huang can be contacted at: xhuang@nuaa.edu.cn

Related articles