 Original Article
 Open Access
 Published:
Reinforcement learning method for machining deformation control based on metainvariant feature space
Visual Computing for Industry, Biomedicine, and Art volume 5, Article number: 27 (2022)
Abstract
Precise control of machining deformation is crucial for improving the manufacturing quality of structural aerospace components. In the machining process, different batches of blanks have different residual stress distributions, which pose a significant challenge to machining deformation control. In this study, a reinforcement learning method for machining deformation control based on a metainvariant feature space was developed. The proposed method uses a reinforcementlearning model to dynamically control the machining process by monitoring the deformation force. Moreover, combined with a metainvariant feature space, the proposed method learns the internal relationship of the deformation control approaches under different stress distributions to achieve the machining deformation control of different batches of blanks. Finally, the experimental results show that the proposed method achieves better deformation control than the two existing benchmarking methods.
Introduction
Structural aerospace components are pivotal components of an aircraft. They are subjected to strict manufacturing standards to ensure improved assembly quality, service performance, product life, and other critical performance criteria. However, because of the high material removal rate during machining of structural components, their large size, and complex residual stress distributions, severe deformation often occurs during their production and processing, for example, bending, twisting, or their combination [1]. The European Union spends 10 million euros yearly on the aerospace manufacturing industry to cope with machining deformation problems [2]. Therefore, controlling the machining deformation of structural aerospace components is a critical and challenging problem in aviation manufacturing.
The deformation control of structural components for machining is shown in Fig. 1. Given a raw blank enclosing the design part, the machining process removes the material between them (Fig. 1a). Because of the initial residual stress distribution in the blank (Fig. 1b), the machined part deforms. In particular, the degree of deformation is determined by the stress distribution of the blank and the relative position of the part within the blank [3], as shown in Figs. 1c and d. Nevertheless, the dimensions of the blank are larger than those of the part, providing a space for position adjustment. Therefore, given a specific initial residual stress distribution of a blank, deformation control requires adjusting the part position in the blank to minimize the resultant deformation of the machined part.
Although the residual stress distribution of a blank can be obtained to predict and control the part deformation, it is challenging to determine a general optimal machining positioning approach tending to a general blank. This is because the stress distribution varies significantly among blanks owing to different heat treatment and prestretching parameters and the random error. Despite the development of traditional machining deformation control methods based on analytical and numerical modeling, these methods significantly depend on the prior residual stress and constitutive equations, both of which are difficult to obtain; thus, they cannot guarantee deformation control accuracy. As emerging dataacquisition techniques can collect a large amount of actual data during machining, it has become possible to develop datadriven approaches for solving manufacturing problems [4], such as industrial robot grasping based on deep reinforcement learning [5], remaining service life prediction of machinery based on deep learning [6], and tool wear prediction based on causal inference [7]. Nevertheless, the significant variations in blank materials and machining conditions make it challenging to adapt many existing datadriven methods to a specific machining deformation control problem.
To address these problems, the authors propose a reinforcement learning method for machining deformation control based on the metainvariant feature space, which is a method for crosscondition learning based on metalearning. Instead of measuring the stress distributions in the entire blank, the deformation force [8, 9] is determined on a few monitoring points as the input. This approach reduces the problem complexity and fully utilizes the nonlinear mapping of machine learning between the force input and adjustment position output. A model can be established using a metainvariant feature space by learning the underlying laws under different stress distributions. This enables the model to dynamically adjust the machining allowance and determine the final machining position based on the onlinemonitored machining data. Before proceeding to the methodology, related work is reviewed first.
Related work
Machining deformation is an essential factor that affects the quality of parts, and its effective control has been investigated extensively. Relevant existing methods are divided into two categories: mechanismbased and datadriven.
Mechanismbased methods
In mechanismbased methods for deformation control, the residual stress of the material to be machined is measured first, and machining deformation is then predicted by analytical or numerical modeling to adjust the process based on the predicted results. Wang et al. [10] used finite element software to simulate the removal process of aluminum alloys and reported that the release and redistribution of residual stress is the main cause of machining deformation. Cerutti and Mocellin [11] considered the effect of the initial residual stress and used a numerical tool to analyze the effect of the machining sequence on machining deformation. Wang et al. [12] developed a slope method to measure the residual stress of materials and controlled the deformation by optimizing the machining position. Wang et al. [13] established an analytical model for predicting the machining deformation of multiframe components based on an energy method and minimized the deformation by optimizing the cutting parameters using a cornstarch suspension. Li et al. [14] established a deformation prediction model between the initial residual stress and finishing allowance. They developed a linearprogramming optimization model to optimize the overall machining deformation. Jiang et al. [15] proposed a nonuniform allowance allocation method based on the interim state stiffness of machining features. Their proposed method can effectively improve the stiffness of a part and hence, reduce its deformation.
The accuracy of mechanismbased deformation control significantly depends on the accuracy of the residual stress measurements. Current methods for measuring residual stress include destructive and nondestructive test methods [16], but their accuracy and efficiency do not satisfy the high requirements of deformation prediction and control.
Datadriven methods
In the datadriven manufacturing era, the extensive growth of data has completely changed data collection and analysis methods [17]. Process control based on data monitoring during machining processes has gradually become effective for improving machining quality [18]. Bakker et al. [19] proposed a new fixture design concept in which the clamping force is controlled by combining sensors and active clamping elements to minimize the deformation of parts during manufacturing. Li et al. [20] developed responsive fixtures for monitoring and controlling machining deformation. Hao et al. [21] reduced machining deformation by controlling the machining sequence, predeformation [22], and machining allowance allocation [23]. Gonzalo et al. [24] developed an intelligent fixture to correct the machining deformation of parts by evaluating the reaction force of clamping points. However, as the machining deformation of parts is highly nonlinear with respect to the observed data, it is difficult to satisfy the accuracy and reliability requirements of deformation control by relying only on the monitoring data in current machining processes.
With the rapid development of automation, an increasing number of tasks have relied on artificial intelligence applications [25]. Many machinelearning methods have been developed to characterize the nonlinearity of deformation control. Reinforcement learning algorithms such as deep Qnetworks (DQNs) [26] have attracted attention in industrial control systems [27], path planning [28], manufacturing scheduling [29], and other industries because of their excellent learning ability. Recently, a reinforcement learning algorithm has been applied to deformation control by dynamically selecting machining processes using monitored machining data [30]; however, its generalization to new problems is somewhat limited. To this end, transfer learning [31] applies learned knowledge to new problems. For example, Alam et al. [32] and Liu et al. [33] used the transfer learning method to enable datadriven models to exhibit improved adaptability in learning the parameters of a manufacturing process and drillingburr prediction, respectively. However, transfer learning is not always effective when significant differences exist between tasks. Metalearning [34] is a learntolearn algorithm that shows satisfactory results in generalization to new tasks. Liu et al. [35] proposed a metainvariant feature space method to accurately predict tool wear across conditions with only a few new samples. Li et al. [36] developed a multitask reinforcement learning method combined with metalearning that could enable an unmanned aerial vehicle to adapt to a new target motion mode faster with only a few training steps. Xiao et al. [37] used a metareinforcement learning algorithm to determine optimal machining parameters during turning. Liu et al. [38] proposed a metareinforcement learning method that incorporated simulations with actual data for machining deformation control of the finishing machining process.
Inspired by the metalearning method, a reinforcement learning method combined with a metainvariant feature space is proposed in this study. The proposed method has distinct advantages over existing methods: (1) Two subnetworks are established for the model to learn the invariant features of the paired conditions; (2) An autoencoder is incorporated into the model, which can map the input to latent variables as invariant features; (3) Reinforcement learning is incorporated into the model, which can dynamically control the machining positions; and (4) The metamodel can learn the underlying and intrinsic features under different stress distributions and control the machining deformation of different blanks.
Methods
As mentioned in the introduction, the residual stress distributions in different batches of blanks are different owing to the variation in blank material preparation, such as the heat treatment parameters and prestretching. In addition, perturbations of stress distributions occur in the same batch of blanks owing to random errors. In this study, these two reasons for distribution variations were considered. First, different groups for different material preparation parameters were set, and random perturbations within each group were added to reflect the random errors within each batch. Next, the deformation forces on a few monitored points were selected as the input, and different batches were paired, that is, machining conditions, using the maximum mean discrepancy (MMD) method. For each pair, a basemodel consisting of two subnetworks was then established to learn its invariant features. The learned model was combined with the principle of metainvariant feature space [35] to make the model learn the intrinsic relationship guiding different batch control approaches to achieve stable and accurate decisionmaking. Finally, when facing a new machining task, the metamodel will use a small amount of monitoring data to finetune the model parameters to adapt to new tasks and achieve accurate machining deformation control. The flowchart of the proposed method is shown in Fig. 2.
The algorithm framework consists of basemodels and a metamodel (Fig. 3). Each basemodel learns a specific task, making process decisions according to a specific pair of machining conditions. First, the groups are paired. For each pair (S, T), a basemodel is defined. Next, cooperative learning is applied to map the marginal distributions of S and T into an invariant feature space of the basemodel, thereby closing the marginal distributions for different conditions. The basemodel then passes the learned results to a metamodel. Finally, the metamodel learns more helpful information in related tasks from the obtained basemodels to attain a metainvariant feature space. In summary, the entire algorithm includes three aspects: condition pairing, basemodel learning, and metamodel learning. Each aspect is described below.
Machining condition pairing
Before training the metainvariant feature space model, the first step is to pair the machining conditions. In this study, MMD, the most widely used in marginal distribution adaptation, was used to measure the distance of the margin distribution between the two conditions. Specifically, for condition set \({\left\{{\mathcal{C}}_{n}\right\}}_{n=1,\dots ,N}\) under N conditions, the first condition, \({\mathcal{C}}_{1}\), is selected as the current condition \({\mathcal{C}}_{\mathrm{cur}}={\mathcal{C}}_{1}\), and the MMDs between \({\mathcal{C}}_{\mathrm{cur}}\) and the remaining N1 candidate conditions are calculated. The candidate condition, \({\mathcal{C}}_{\mathrm{can}}\), which has the minimum MMD to \({\mathcal{C}}_{\mathrm{cur}}\), is paired with the current condition, for example, \(\left({\mathcal{C}}_{\mathrm{cur}},{\mathcal{C}}_{\mathrm{can}}\right)\). Next, \({\mathcal{C}}_{\mathrm{cur}}\) is replaced by the just paired \({\mathcal{C}}_{\mathrm{can}}\), and the new \({\mathcal{C}}_{\mathrm{cur}}\) is paired with the remaining N2 candidate conditions. This procedure is repeated until all conditions are paired.
The S and T data samples are embedded into the reproduced kernel Hilbert space \({\mathcal{H}}^{Z}\) to calculate the MMDs of both conditions, in which each function \(f\) corresponds to a feature map. Let \({P}^{T}\) and \({P}^{S}\) denote the data distributions in S and T, respectively. The means of the data distributions, that is, \({\mu }_{{P}^{S}}\) and \({\mu }_{{P}^{T}}\), are embedded under \(f\) as follows.
Equation (1) represents the kernel concept that simplifies the calculation of the feature space transformation. The square of the MMD between \({P}^{T}\) and \({P}^{S}\) can thus, be expressed as follows:
where \({x}_{i}^{S}\) is the i^{th} sample from condition S, which is a vector, \(k\left({x}_{i}^{con},{x}_{j}^{con}\right)=\mathrm{exp}\left(\frac{{\Vert {x}_{i}^{con}{x}_{j}^{con}\Vert }^{2}}{2{\sigma }^{2}}\right)\) represents the Gaussian kernel, \(\mathcal{F}\) is the function space of f, and m and n are the numbers of samples in S and T, respectively.
Basemodel learning
The monitoring data are somewhat different because of the different residualstress distributions from different batches of blanks. The model trained only in a specific batch could not achieve an ideal deformation control effect in other batches. Therefore, an invariant feature space [39] was designed in this study, into which the features under different distributions were transformed through collaborative learning of the reinforcement learning model under paired machining conditions. Therefore, common features under different machining conditions were extracted to lay a foundation for metalearning to determine the intrinsic laws of the model. The invariant feature space model framework is shown in Fig. 4, and the parameters are defined as follows:

(1)
\({S}_{S}\) and \({S}_{T}\) are the monitoring deformation force data of Agent_S and Agent_T, respectively;

(2)
\({En}_{S}\) and \({En}_{T}\) are the encoding networks of Agent_S and Agent_T, respectively;

(3)
\({Z}_{S}\) and \({Z}_{T}\) are the latent variables of Agent_S and Agent_T, respectively;

(4)
\({De}_{S}\) and \({De}_{T}\) are the decoding networks of Agent_S and Agent_T, respectively;

(5)
\({RL}_{S}\) and \({RL}_{T}\) are the reinforcement learning networks used for process decisionmaking of Agent_S and Agent_T, respectively;

(6)
\({\mathcal{L}}_{S}^{1}\) and \({\mathcal{L}}_{T}^{1}\) are the reconstruction losses of monitoring data \({S}_{S}\) and \({S}_{T}\), respectively;

(7)
\({\mathcal{L}}_{M}^{2}\) is the match loss of the latent variables \({Z}_{S}\) and \({Z}_{T}\);

(8)
\({\mathcal{L}}_{S}^{3}\) and \({\mathcal{L}}_{T}^{3}\) are the losses of reinforcement learning models \({RL}_{S}\) and \({RL}_{T}\), respectively.
The basemodel uses Agent_S and Agent_T to take machining decisions on conditions S and T, respectively. First, states \({S}_{S}\) and \({S}_{T}\) are mapped onto latent variables \({Z}_{S}\) and \({Z}_{T}\) to construct the invariant feature space through encoding networks \({En}_{S}\) and \({En}_{T}\), respectively. Simultaneously, decoding networks \({De}_{S}\) and \({De}_{T}\) are trained, forming an autoencoder whose outputs are \({S}_{S}^{^{\prime}}\) and \({S}_{T}^{^{\prime}}\), respectively, to ensure the reversibility of the mapping, that is, to retain the information of the input data as much as possible. The latent variables of the two autoencoders, \({Z}_{S}\) and \({Z}_{T}\), are used to train the invariant feature space of the pair (S, T). The reinforcement learning models, \({RL}_{S}\) and \({RL}_{T}\), then determine the machining processes according to latent variables \({Z}_{S}\) and \({Z}_{T}\). In basemodel learning, the loss function of the basemodel comprises three parts: reconstruction, match, and reinforcement learning losses.

(1)
Reconstruction loss:
$${\mathcal{L}}_{S}^{1}=MSE({S}_{S}{S}_{S}^{^{\prime}})$$(3)$${\mathcal{L}}_{T}^{1}=MSE({S}_{T}{S}_{T}^{^{\prime}})$$(4)Here, MSE denotes the mean square error.

(2)
Match loss:
$${\mathcal{L}}_{M}^{2}=\frac{1}{\left{z}^{S}\right}\sum l({Z}_{S},{Z}_{T})$$(5)In Eq. (5), \(l\left({Z}_{S},{Z}_{T}\right)=1\mathrm{cos}\left({Z}_{S},{Z}_{T}\right)=\frac{{\Vert {Z}_{S}\Vert }_{2}\bullet {\Vert {Z}_{T}\Vert }_{2}{Z}_{S}\bullet {Z}_{T}}{{\Vert {Z}_{S}\Vert }_{2}\bullet {\Vert {Z}_{T}\Vert }_{2}}\). The cosine distance is adopted as the metric distance between the latent variables rather than the absolute difference in length because the angular difference can reflect the characteristics of the encoded monitoring signal more effectively.

(3)
Reinforcement learning loss:
The reinforcement learning model for each condition was trained based on monitoring data and latent variables. During the machining process, the model determined the machining position to obtain the final part. In terms of implementation, the DQN algorithm was used in this study to achieve machining deformation control, in which the state, action, and reward are indispensable parts of the algorithm.
State
The deformation force can be monitored in real time during machining and contains deformation and stress information of the parts [8, 9]. By taking the position adjustment of a part as an example, the blank can be divided into two fixed process layers and one dynamic adjustment layer before machining [23], as shown in Fig. 5. The cavities of the fixed process layers are removed by multilayer rough machining, during which the deformation force information can reflect the initial stress information of the blank. After machining the fixed process layers, the dynamic adjustment layer is machined, during which the current machining position and deformation force data represent the current machining state. Therefore, the state of reinforcement learning is a combination of (1) the deformation force of the fixed process layer, (2) current machining position of the dynamic adjustment layer, and (3) deformation force of the dynamic adjustment layer.
Action
The dynamic adjustment layer is divided into several sublayers with specific intervals; that is, several machining positions are determined, and each is regarded as an action.
Reward
The reward function represents the direction of training optimization. Because the deformation of the machined part increases with increasing deformation force, a low force is required for deformation control. Therefore, the negative maximum absolute value of the deformation force is considered the reward function for reinforcement learning:
where \({F}_{n}\) is the deformation force of the n^{th} monitoring point during the machining process. When the deformation force is large, the reward is small; thus, the model reduces the possibility of selecting this position.
The DQN model has two value functions with the same structure, but different parameters expressed as target_net and eval_net. eval_net is used to evaluate the greedy policy, whereas target_net is used to estimate its value. Therefore, based on the parameterupdating mechanism of the DQN model, the loss functions \({\mathcal{L}}_{S}^{3}\) and \({\mathcal{L}}_{T}^{3}\) of Agent_S and Agent_T can be expressed as follows, respectively:
where γ is a discount factor, \({reward}_{S}\) and \({reward}_{T}\) are the reward values obtained from Eq. (6), \(\mathrm{max}{Q}_{S}^{target}\) and \(\mathrm{max}{Q}_{T}^{target}\) are the maximum \(Q\) values of target_net in the current state, and \({Q}_{S}^{eval}\) and \({Q}_{T}^{eval}\) are the \(Q\) values of eval_net in the current state.
Thus, the total loss function, \(\mathcal{L}\), is obtained by summing the loss functions of Eqs. (3)–(5), (7), and (8). Parameter \({\theta }_{base}\) of this basemodel can be trained and updated using the gradient descent method:
where \(\alpha\) is the learning rate of the basemodel, and \({\nabla }_{{\theta }_{base}}\) is the gradient with respect to \({\theta }_{base}\).
Metamodel learning
The metalearning method derives the law of deformation control from multiple tasks (pairs) to obtain a metainvariant feature space. This achieves the machining deformation control of different batches of blanks. The network structure of the metamodel is the same as that of the basemodel, but the parameters are different. The metamodel can learn from different basemodels and rapidly adapt to a new task with limited data. With the help of the metamodel memory, the historical experience of the basemodels is stored for training and updating the metamodel parameters:
where \({\theta }_{meta}\) is the metamodel parameter, \(\beta\) is the metalearning rate, \({\nabla }_{{\theta }_{meta}}\) is the gradient with respect to \({\theta }_{meta}\), \({\mathcal{T}}_{i}\) is i^{th} task, and \(p\left(\mathcal{T}\right)\) is the task distribution set.
The algorithm of the reinforcement learning method based on the metainvariant feature space is outlined as follows.
Results and discussion
Machining parameters and finite element settings
In this study, the deformation of the machined part was controlled by changing its position in the blank in the thickness direction, as shown in Figs. 1 and 5. The shapes of the three analogous parts are shown in Fig. 6b. The blank dimensions were the same for the three parts (Fig. 6a), whose material was 7075T651 aluminum alloy. The thicknesses of the fixed process and dynamic adjustment layers of the part were 10 and 9 mm, respectively (Fig. 6c).
The simulation was performed using \({ABAQUS}^{TM}\). The meshing of the finite elements is shown in Fig. 7a, and the fixed restraints are shown in Fig. 7b. Regarding data collection during machining, the deformation forces of the parts were probed at four monitoring points, as shown in Fig. 7b.
Initial residualstress distributions of different blanks
In this subsection, simulations of the initial residualstress distributions of different blank batches for monitoring the data collection are discussed. Aluminum alloys are generally prepared by hot rolling, quenching, stretching, aging, and other steps [40]. During quenching, significant residual stress is generated, and the blank surface is under compressive stress, whereas the core is under tensile stress. A prestretching process is typically applied to reduce stress and induce 1%3% plastic deformation to the blank on a stretching machine, thereby redistributing the residual stress in the thickness direction [41]. In this study, \({ABAQUS}^{TM}\) was used to simulate quenching and prestretching of the materials to obtain the resultant residualstress distribution [42, 43].
The mechanical and thermophysical properties of 7075 aluminum alloy were obtained from ref. [44]. The specific preprocess is as follows. First, the material was heated to 465–475 °C. Next, it was subjected to quenching in water at 25 °C and mechanically stretched, exhibiting a 1%–3% permanent plastic deformation. In the simulations, six groups with different parameter combinations were selected, and each group corresponded to a machining condition (working condition or batch). The temperature and mechanical stretching parameters are listed in Table 1.
Figure 8 shows the different residual stress fields of the six groups. Compressive stress existed near the blank surface, and tensile stress existed in the interior, conforming to the stress distribution. The six stress distribution groups were regarded as the stress field distributions of the six blank batches. However, the heating temperature and stretching amount varied within a specific range. Therefore, it was difficult to precisely control them at a constant value, which was a reason for the random difference in the stress field within the same batch. Assuming that this random error followed a normal distribution, the simulated stress distribution was adopted as mean \(\mu\) in each group, and the field distributions were randomized using the standard deviation, \(\sigma =10\%\times \mu\). Many subconditions were then randomly sampled within this batch (in this study, there were 200 samples per group).
Machining condition pairing
For the implementation, Groups 1–5 were used to train the basemodels and metamodel, whereas Group 6 was used for testing. For each group (batch), 200 stress distributions were sampled. In each sample, the fixed process layer was further divided into five sublayers, which were sequentially machined. When machining each sublayer, four force probes at the monitoring points received the deformation force (Fig. 7b). Each sample had 5 × 4 = 20 deformation forces, forming a vector x of length 20. Thus, each group contained 200 samples, forming a 200 × 20 input data matrix. Before model training, the machining conditions were paired using the MMD obtained from Eq. (2) based on the deformation force samples of the different parts, as listed in Table 2.
Model training
The basemodels and metamodel were trained according to the pairing results. The convergence curves of Parts 1, 2, and 3 plotted during the training are shown in Figs. 9, 10, and 11, respectively. For the basemodel training, the training error sharply fluctuated at the beginning because the reinforcement learning used a greedy strategy to randomly select actions during the initial stage. With increased training steps, all the basemodels in the four pairs learned how to make correct decisions from experience; therefore, the training errors gradually decreased and eventually stabilized. The metamodel learned from the experience of the basemodels. Despite the fluctuating errors in the later stage of the training curve owing to significant differences among the conditions, the metamodel converged gradually. Verification of the final deformation control performance is presented in the next subsection. Additional training steps can be incorporated to reduce training loss and improve convergence results.
Comparative verification and discussion
The proposed method is compared with the middle positioning method (that is, positioning the part in the middle position in the thickness direction) and the metareinforcement learning method [38] to verify the deformation control effect of the proposed method. We sampled 100 stress distributions from Group 6 as 100 testing samples. Similar to the training stage, each sample obtained 20 deformation forces after machining the fixed process layer. For each testing sample vector from Group 6, the MMDs between the sample and all input data matrices from other groups were first calculated, and the group with the minimum MMD was selected for pairing, for example, Group 3. Next, the basemodel, which only tested the trained metamodel by assigning Groups 3 and 6 as Agent_S and Agent_T, respectively, was skipped. Finally, the metamodel could rapidly generalise to this new pair and make correct machining position decisions. The machining deformation of each testing sample was defined as the maximum absolute value of the machining deformations probed at the four monitoring points in Fig. 7c.
The machining deformations of the 100 testing cases validated using these three algorithms are presented in the Appendix. These three methods are ranked as best position, suboptimal position, and worst position. The “best position,” “worst position,” and “suboptimal position” indicate the smallest deformation, largest deformation, and somewhere in between, respectively. If two methods yield a similar deformation value, they rank the best or suboptimal position according to the value compared to the third value. The ranks of the 100 samples for each method are shown in Fig. 12.
Based on the results of the comparative experiments, the proposed algorithm performed best in all three parts. Taking Part 1 as an example, the decisionmaking results of the proposed method are 91% for the optimal position, 8% for the suboptimal position, and only 4% for the worst position. Compared with the other two methods, the decisionmaking results of the proposed metareinforcement learning method are 81% for the optimal position and 19% for the suboptimal position. In contrast, those of the middle position method are 1% for the optimal position, 95% for the suboptimal position, and 4% for the worst position. Similar conclusions can be drawn from Fig. 12 for the other two parts. From the controlling effect perspective, the proposed method not only exhibits the highest accuracy in controlling machining deformation but also shows good stability to the shape of a part. The metareinforcement learning method fares significant worse in the third part than in the other two parts. However, the proposed method achieves improved and stable performance in all three parts, demonstrating that the proposed method learns the intrinsic laws governing stress distributions and can make correct and stable decisions.
Conclusions
This study proposes a reinforcement learning method based on a metainvariant feature space used to control machining deformation with different batches of blanks. The proposed method first establishes two subnetworks to learn the invariant features of the paired conditions through cooperative learning. A metamodel is then used to learn the essential laws governing the spatial changes in invariant features under multiple pairs of conditions based on the metalearning principle. The metamodel can be adapted to achieve precise machining deformation control under new conditions with only a small amount of monitoring data. Compared to two benchmarking methods, the proposed method achieves improved deformation control when a new batch of blanks is machined. Moreover, the proposed method can be valuable for solving other manufacturing problems caused by differences in task distribution.
In future studies, the efficiency of the model training should be considered. In addition, the proposed method was only verified in a simulation environment; although it is viable and practical, it must be validated based on physical machining experiments.
Appendix
The machining deformation produced by different strategies under 100 samples of stress distribution
Index  Part 1  Part 2  Part 3  

Proposed method (mm)  Metareinforcement learning (mm)  Middle position (mm)  Proposed method (mm)  Metareinforcement learning (mm)  Middle position (mm)  Proposed method (mm)  Metareinforcement learning (mm)  Middle position (mm)  
1  0.0239  0.0239  0.0405  0.0128  0.0128  0.0461  0.0336  0.0660  0.0336 
2  0.0208  0.0208  0.0577  0.0148  0.0148  0.0501  0.0144  0.0316  0.0520 
3  0.0192  0.0192  0.0580  0.0102  0.0102  0.0563  0.0132  0.0132  0.0513 
4  0.0223  0.0223  0.0476  0.0159  0.0159  0.0697  0.0291  0.0678  0.0393 
5  0.0213  0.0213  0.0441  0.0173  0.0173  0.0544  0.0281  0.0675  0.0369 
6  0.0122  0.0122  0.0455  0.0238  0.0238  0.0520  0.0185  0.0373  0.0393 
7  0.0127  0.0127  0.0473  0.0106  0.0331  0.0539  0.0193  0.0659  0.0409 
8  0.0130  0.0130  0.0520  0.0260  0.0260  0.0276  0.0199  0.0573  0.0453 
9  0.0240  0.0240  0.0459  0.0220  0.0220  0.0649  0.0301  0.0664  0.0386 
10  0.0092  0.0092  0.0444  0.0229  0.0229  0.0482  0.0182  0.0542  0.0370 
11  0.0220  0.0220  0.0591  0.0200  0.0200  0.0588  0.0351  0.0351  0.0514 
12  0.0183  0.0183  0.0550  0.0124  0.0124  0.0481  0.0253  0.0603  0.0468 
13  0.0111  0.0111  0.0495  0.0229  0.0229  0.0682  0.0139  0.0139  0.0433 
14  0.0188  0.0188  0.0648  0.0134  0.0134  0.0428  0.0103  0.0579  0.0567 
15  0.0140  0.0140  0.0458  0.0164  0.0164  0.0557  0.0114  0.0396  0.0400 
16  0.0128  0.0128  0.0545  0.0085  0.0230  0.0489  0.0143  0.0421  0.0482 
17  0.0165  0.0165  0.0639  0.0218  0.0218  0.0446  0.0121  0.0570  0.0557 
18  0.0137  0.0137  0.0504  0.0132  0.0132  0.0664  0.0209  0.0550  0.0435 
19  0.0127  0.0127  0.0525  0.0152  0.0461  0.0461  0.0205  0.0205  0.0450 
20  0.0168  0.0168  0.0651  0.0122  0.0331  0.0461  0.0108  0.0505  0.0573 
21  0.0352  0.0095  0.0352  0.0151  0.0151  0.0421  0.0169  0.0438  0.0305 
22  0.0121  0.0121  0.0585  0.0151  0.0511  0.0570  0.0103  0.0103  0.0517 
23  0.0149  0.0149  0.0431  0.0146  0.0146  0.0513  0.0209  0.0457  0.0371 
24  0.0193  0.0604  0.0604  0.0258  0.0301  0.0258  0.0113  0.0113  0.0533 
25  0.0111  0.0111  0.0515  0.0443  0.0151  0.0605  0.0138  0.0563  0.0440 
26  0.0097  0.0097  0.0498  0.0148  0.0148  0.0601  0.0182  0.0182  0.0429 
27  0.0136  0.0136  0.0581  0.0125  0.0125  0.0545  0.0104  0.0383  0.0508 
28  0.0178  0.0580  0.0580  0.0196  0.0196  0.0488  0.0510  0.0543  0.0510 
29  0.0122  0.0122  0.0573  0.0195  0.1160  0.0606  0.0189  0.0511  0.0501 
30  0.0163  0.0163  0.0557  0.0131  0.0131  0.0529  0.0242  0.0242  0.0474 
31  0.0146  0.0146  0.0600  0.0197  0.0197  0.0600  0.0524  0.0606  0.0524 
32  0.0129  0.0129  0.0423  0.0125  0.0317  0.0675  0.0199  0.0503  0.0356 
33  0.0195  0.0195  0.0487  0.0132  0.0132  0.0478  0.0262  0.0262  0.0411 
34  0.0150  0.0150  0.0570  0.0119  0.0293  0.0568  0.0105  0.0105  0.0500 
35  0.0253  0.0296  0.0253  0.0138  0.0138  0.0451  0.0196  0.0587  0.0196 
36  0.0150  0.0449  0.0449  0.0185  0.0185  0.0568  0.0227  0.0227  0.0380 
37  0.0150  0.0460  0.0460  0.0096  0.0283  0.0611  0.0598  0.0388  0.0388 
38  0.0674  0.0124  0.0674  0.0265  0.0265  0.0785  0.0157  0.0410  0.0591 
39  0.0243  0.0353  0.0590  0.0141  0.0432  0.0577  0.0282  0.0345  0.0526 
40  0.0215  0.0215  0.0645  0.0208  0.0208  0.0482  0.0154  0.0381  0.0571 
41  0.0394  0.0194  0.0597  0.0182  0.1061  0.0690  0.0123  0.0499  0.0524 
42  0.0130  0.0130  0.0661  0.0151  0.0470  0.0570  0.0130  0.0518  0.0579 
43  0.0154  0.0154  0.0550  0.0098  0.0098  0.0498  0.0225  0.0643  0.0469 
44  0.0547  0.0146  0.0499  0.0117  0.0472  0.0522  0.0217  0.0628  0.0428 
45  0.0129  0.0129  0.0443  0.0223  0.0223  0.0594  0.0206  0.0562  0.0372 
46  0.0290  0.0290  0.0358  0.0095  0.0095  0.0533  0.0293  0.0342  0.0293 
47  0.0176  0.0176  0.0558  0.0310  0.0310  0.0691  0.0257  0.0257  0.0470 
48  0.0082  0.0486  0.0486  0.0143  0.0143  0.0588  0.0176  0.0176  0.0437 
49  0.0142  0.0634  0.0634  0.0244  0.0354  0.0591  0.0132  0.0132  0.0549 
50  0.0130  0.0130  0.0493  0.0539  0.0170  0.0533  0.0614  0.0614  0.0421 
51  0.0442  0.0260  0.0442  0.0447  0.0290  0.0358  0.0329  0.0329  0.0368 
52  0.0194  0.0194  0.0508  0.0103  0.0103  0.0360  0.0137  0.0330  0.0455 
53  0.0202  0.0271  0.0271  0.0195  0.0195  0.0655  0.0221  0.0269  0.0221 
54  0.0124  0.0124  0.0481  0.0146  0.0146  0.0465  0.0200  0.0482  0.0415 
55  0.0148  0.0567  0.0567  0.0263  0.0263  0.0447  0.0150  0.0581  0.0494 
56  0.0124  0.0124  0.0581  0.0189  0.0189  0.0555  0.0188  0.0444  0.0512 
57  0.0306  0.0306  0.0687  0.0590  0.0346  0.0590  0.0617  0.0457  0.0617 
58  0.0111  0.0111  0.0637  0.0132  0.0132  0.0506  0.0154  0.0504  0.0560 
59  0.0290  0.0115  0.0564  0.0136  0.1143  0.0530  0.0155  0.0381  0.0505 
60  0.0236  0.0284  0.0284  0.0152  0.0152  0.0571  0.0229  0.0562  0.0229 
61  0.0260  0.0260  0.0443  0.0157  0.0157  0.0553  0.0334  0.0703  0.0371 
62  0.0232  0.0232  0.0539  0.0266  0.0266  0.0454  0.0305  0.0305  0.0446 
63  0.0183  0.0183  0.0602  0.0154  0.0154  0.0436  0.0131  0.0131  0.0523 
64  0.0088  0.0493  0.0493  0.0598  0.0232  0.0598  0.0172  0.0172  0.0422 
65  0.0097  0.0097  0.0614  0.0169  0.0169  0.0643  0.0167  0.0604  0.0540 
66  0.0225  0.0594  0.0594  0.0231  0.0979  0.0600  0.0157  0.0157  0.0523 
67  0.0146  0.0146  0.0600  0.0130  0.0130  0.0594  0.0096  0.0515  0.0535 
68  0.0264  0.0452  0.0452  0.0130  0.0339  0.0547  0.0374  0.0340  0.0374 
69  0.0099  0.0099  0.0532  0.0094  0.0498  0.0647  0.0165  0.0421  0.0458 
70  0.0230  0.0230  0.0596  0.0241  0.0241  0.0548  0.0160  0.0453  0.0524 
71  0.0126  0.0126  0.0500  0.0209  0.0209  0.0579  0.0131  0.0131  0.0435 
72  0.0220  0.0220  0.0672  0.0124  0.0124  0.0581  0.0157  0.0515  0.0587 
73  0.0346  0.0236  0.0708  0.0246  0.0246  0.0717  0.0169  0.0450  0.0638 
74  0.0258  0.0274  0.0274  0.0123  0.0123  0.0574  0.0312  0.0546  0.0217 
75  0.0092  0.0092  0.0530  0.0098  0.0480  0.0503  0.0457  0.0588  0.0457 
76  0.0163  0.0163  0.0554  0.0118  0.0118  0.0645  0.0230  0.0561  0.0474 
77  0.0081  0.0081  0.0570  0.0211  0.0211  0.0280  0.0164  0.0164  0.0489 
78  0.0235  0.0235  0.0518  0.0260  0.0260  0.0442  0.0292  0.0622  0.0443 
79  0.0602  0.0087  0.0602  0.0244  0.0244  0.0292  0.0143  0.0373  0.0528 
80  0.0270  0.0270  0.0684  0.0275  0.0275  0.0689  0.0204  0.0457  0.0610 
81  0.0101  0.0101  0.0562  0.0089  0.0089  0.0555  0.0190  0.0618  0.0475 
82  0.0320  0.0320  0.0401  0.0431  0.0431  0.0660  0.0323  0.0323  0.0323 
83  0.0260  0.0260  0.0781  0.0184  0.0451  0.0585  0.0184  0.0609  0.0696 
84  0.0116  0.0116  0.0455  0.0084  0.0527  0.0499  0.0183  0.0420  0.0389 
85  0.0150  0.0587  0.0587  0.0134  0.0134  0.0524  0.0429  0.0429  0.0514 
86  0.0204  0.0204  0.0479  0.0165  0.0165  0.0556  0.0262  0.0605  0.0410 
87  0.0088  0.0554  0.0554  0.0203  0.0203  0.0517  0.0152  0.0474  0.0492 
88  0.0199  0.0199  0.0703  0.0157  0.0766  0.0456  0.0111  0.0620  0.0622 
89  0.0181  0.0689  0.0689  0.0084  0.0084  0.0574  0.0105  0.0105  0.0610 
90  0.0156  0.0156  0.0695  0.0244  0.0244  0.0463  0.0091  0.0091  0.0624 
91  0.0137  0.0137  0.0573  0.0148  0.0591  0.0640  0.0125  0.0524  0.0503 
92  0.0161  0.0161  0.0524  0.0329  0.0329  0.0410  0.0244  0.0623  0.0446 
93  0.0268  0.0268  0.0349  0.0205  0.0205  0.0709  0.0277  0.0342  0.0277 
94  0.0149  0.0149  0.0568  0.0132  0.0132  0.0495  0.0124  0.0568  0.0487 
95  0.0148  0.0148  0.0417  0.0188  0.0188  0.0606  0.0221  0.0221  0.0349 
96  0.0164  0.0164  0.0535  0.0521  0.0099  0.0616  0.0234  0.0508  0.0459 
97  0.0087  0.0087  0.0640  0.0118  0.0118  0.0501  0.0171  0.0577  0.0555 
98  0.0541  0.0122  0.0541  0.0277  0.0277  0.0358  0.0176  0.0397  0.0481 
99  0.0127  0.0127  0.0521  0.0094  0.0438  0.0446  0.0203  0.0203  0.0448 
100  0.0079  0.0495  0.0495  0.0245  0.0245  0.0411  0.0159  0.0159  0.0419 
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Abbreviations
 MMD:

Maximum mean discrepancy
 DQN:

Deep Qnetwork
 MSE:

Mean square error
References
Chantzis D, VanDerVeen S, Zettler J, Sim WM (2013) An industrial workflow to minimise part distortion for machining of large monolithic components in aerospace industry. Proced CIRP 8:281286. https://doi.org/10.1016/j.procir.2013.06.103
Sim WM (2010) Challenges of residual stress and part distortion in the civil airframe industry. Int J Microstruct Mater Prop 5(45):446455. https://doi.org/10.1504/IJMMP.2010.037621
Nervi S (2005) A mathematical model for the estimation of the effects of residual stresses in aluminum plates. Dissertation, Washington University in St. Louis.
Mahiri F, Najoua A, Souda SB (2020) Datadriven sustainable smart manufacturing: a conceptual framework. Paper presented at the 2020 international conference on intelligent systems and computer vision, IEEE, Fez, 9–11 June 2020. https://doi.org/10.1109/ISCV49265.2020.9204337
Liu YK, Xu H, Liu D, Wang LH (2022) A digital twinbased simtoreal transfer for deep reinforcement learningenabled industrial robot grasping. Robot Comput Int Manuf 78:102365. https://doi.org/10.1016/j.rcim.2022.102365
Jing T, Tian XT, Hu H, Ma LP (2022) Deep learningbased cloudedge collaboration framework for remaining useful life prediction of machinery. IEEE Trans Ind Informat 18(10):72087218. https://doi.org/10.1109/TII.2021.3138510
Hua JQ, Li YG, Liu CQ, Wang LH (2022) A zeroshot prediction method based on causal inference under nonstationary manufacturing environments for complex manufacturing systems. Robot Comput Int Manuf 77:102356. https://doi.org/10.1016/j.rcim.2022.102356
Huang C, Liu CQ, Zhao ZW, Liu MF, Guo LJ (2020) A method for residual stress field reconstruction of structural parts based on deformation force data. Aerosp Shanghai 37(3):133139.
Wang BL (2017) An adaptive adjustment method of floating clamping for large complex structural parts NC Machining. Dissertation, Nanjing University of Aeronautics and Astronautics.
Wang ZJ, Chen WY, Zhang YD, Chen ZT, Liu Q (2005) Study on the machining distortion of thinwalled part caused by redistribution of residual stress. Chin J Aeronaut 18(2):175179. https://doi.org/10.1016/S10009361(11)603257
Cerutti X, Mocellin K (2016) Influence of the machining sequence on the residual stress redistribution and machining quality: analysis and improvement using numerical simulations. Int J Adv Manuf Technol 83(1):489503. https://doi.org/10.1007/s0017001575214
Wang ZB, Sun JF, Liu LB, Wang RQ, Chen WY (2019) An analytical model to predict the machining deformation of frame parts caused by residual stress. J Mater Process Technol 274:116282. https://doi.org/10.1016/j.jmatprotec.2019.116282
Wang SQ, He CL, Cao ZM (2021) Machining distortion in the milling of multiframe components. J Manuf Processes 68:11581175. https://doi.org/10.1016/j.jmapro.2021.06.024
Li XY, Li L, Yang YF, Zhao GL, He N, Ding XC et al (2020) Machining deformation of singlesided component based on finishing allowance optimization. Chin J Aeronaut 33(9):24342444. https://doi.org/10.1016/j.cja.2019.09.015
Jiang S, Li YG, Liu CQ (2018) A nonuniform allowance allocation method based on interim state stiffness of machining features for NC programming of structural parts. Vis Comput Ind Biomed Art 1(1):4. https://doi.org/10.1186/s4249201800052
Guo J, Fu HY, Pan B, Kang RK (2021) Recent progress of residual stress measurement methods: a review. Chin J Aeronaut 34(2):5478. https://doi.org/10.1016/j.cja.2019.10.010
Xu K, Li YG, Liu CQ, Liu X, Hao XZ, Gao J et al (2020) Advanced data collection and analysis in datadriven manufacturing process. Chin J Mech Eng 33(1):43. https://doi.org/10.1186/s1003302000459x
Ahmad MI, Yusof Y, Daud ME, Latiff K, Kadir AZA, Saif Y (2020) Machine monitoring system: a decade in review. Int J Adv Manuf Technol 108(1112):36453659. https://doi.org/10.1007/s00170020056203
Bakker OJ, Papastathis TN, Popov AA, Ratchev SM (2013) Active fixturing: literature review and future research directions. Int J Product Res 51(11):31713190. https://doi.org/10.1080/00207543.2012.695893
Li YG, Liu CQ, Hao XZ, Gao J, Maropoulos PG (2015) Responsive fixture design using dynamic product inspection and monitoring technologies for the precision machining of largescale aerospace parts. CIRP Ann Manuf Technol 64(1):173176. https://doi.org/10.1016/j.cirp.2015.04.025
Hao XZ, Li YG, Zhao ZW, Liu CQ (2019) Dynamic machining process planning incorporating inprocess workpiece deformation data for largesize aircraft structural parts. Int J Comput Integr Manuf 32(2):136147. https://doi.org/10.1080/0951192X.2018.1529431
Hao XZ, Li YG, Li MQ, Liu CQ (2019) A part deformation control method via active predeformation based on online monitoring data. Int J Adv Manuf Technol 104(5):26812692. https://doi.org/10.1007/s0017001904127w
Hao XZ, Li YG, Huang C, Li MQ, Liu CQ, Tang K (2020) An allowance allocation method based on dynamic approximation via online inspection data for deformation control of structural parts. Chin J Aeronaut 33(12):34953508. https://doi.org/10.1016/j.cja.2020.03.038
Gonzalo O, Seara JM, Guruceta E, Izpizua A, Esparta M, Zamakona I et al (2017) A method to minimize the workpiece deformation using a concept of intelligent fixture. Robot Comput Integr Manuf 48:209218. https://doi.org/10.1016/j.rcim.2017.04.005
Wiedeman C, Wang G, Kruger U (2020) Modeling of moral decisions with deep learning. Vis Comput Ind Biomed Art 3(1):27. https://doi.org/10.1186/s42492020000639
Mnih V, Kavukcuoglu K, Silver D, Graves A, Antonoglou I, Wierstra D et al (2013) Playing atari with deep reinforcement learning. http://arxiv.org/abs/1312.5602v1. Accessed 19 Dec 2013
Zhong K, Yang ZB, Xiao GQ, Li XP, Yang WD, Li KL (2022) An efficient parallel reinforcement learning approach to crosslayer defense mechanism in industrial control systems. IEEE Trans Parall Distrib Syst 33(11):29792990. https://doi.org/10.1109/TPDS.2021.3135412
Huang ZJ, Lin HQ, Zhang GC (2022) The USV path planning based on an improved DQN algorithm. Paper presented at the 2021 international conference on networking, communications and information technology, IEEE, Manchester, 26–27 December 2021. https://doi.org/10.1109/netcit54147.2021.00040
Moon J, Jeong J (2021) Smart manufacturing scheduling system: DQN based on cooperative edge computing. Paper presented at the 2021 15th international conference on ubiquitous information management and communication, IEEE, Seoul, 4–6 January 2021. https://doi.org/10.1109/IMCOM51814.2021.9377434
Liu XY (2020) Machining deformation prediction and control of aerospace structural parts based on deformation force monitor data. Dissertation, Nanjing University of Aeronautics and Astronautics.
Panigrahi S, Nanda A, Swarnkar T (2021) A Survey on Transfer Learning. In: Mishra D, Buyya R, Mohapatra P, Patnaik S (eds) Intelligent and Cloud Computing. Smart Innovation, Systems and Technologies, vol 194. Springer, Singapore, pp 781–789. https://doi.org/10.1007/9789811559716_83
Alam MF, Shtein M, Barton K, Hoelzle D (2022) Reinforcement learning enabled autonomous manufacturing using transfer learning and probabilistic reward modeling. IEEE Control Syst Lett 7:508513. https://doi.org/10.1109/LCSYS.2022.3188014
Liu SM, Lu YQ, Zheng P, Shen H, Bao JS (2022) Adaptive reconstruction of digital twins for machining systems: a transfer learning approach. Robot Comput Integr Manuf 78:102390. https://doi.org/10.1016/j.rcim.2022.102390
Huisman M, van Rijn JN, Plaat A (2021) A survey of deep metalearning. Artif Intell Rev 54(6):44834541. https://doi.org/10.1007/s10462021100044
Liu CQ, Li YG, Li JJ, Hua JQ (2022) A metainvariant feature space method for accurate tool wear prediction under cross conditions. IEEE Trans Ind Informat 18(2):922931. https://doi.org/10.1109/TII.2021.3070109
Li B, Gan ZG, Chen DQ, Aleksandrovich DS (2020) UAV maneuvering target tracking in uncertain environments based on deep reinforcement learning and metalearning. Remote Sens 12(22):3789. https://doi.org/10.3390/rs12223789
Xiao QG, Li CB, Tang Y, Li LL (2021) Metareinforcement learning of machining parameters for energyefficient process control of flexible turning operations. IEEE Trans Automat Sci Eng 18(1):518. https://doi.org/10.1109/TASE.2019.2924444
Liu CQ, Li YG, Huang C, Zhao YJ, Zhao ZW (2022) A metareinforcement learning method by incorporating simulation and real data for machining deformation control of finishing process. Int J Product Res (in press). https://doi.org/10.1080/00207543.2022.2027041
Gupta A, Devin C, Liu YX, Abbeel P, Levine S (2017) Learning invariant feature spaces to transfer skills with reinforcement learning. Paper presented at the 5th international conference on learning representations, ICLR, Toulon, 24–26 April 2017.
Koç M, Culp J, Altan T (2006) Prediction of residual stresses in quenched aluminum blocks and their reduction through cold working processes. J Mater Process Technol 174(13):342354. https://doi.org/10.1016/j.jmatprotec.2006.02.007
Gang GL, Wang LY, Liu RC (2004) Prestretch process analysis of aluminium alloy thick plate. Light Alloy Fabricat Technol 32(4):2729.
Zhang YY, Wu YX, Li LM, Zhang MR (2008) Finite element simulation of residual stress in prestretching thickplates of 7075 Aluminum alloy after quenching. Hot Work Technol 37(14):8891.
Wang QC (2003) Evaluation and relief of residual stresses in aluminum alloys for aircraft structures. Dissertation, Zhejiang University.
Zhao LL, Zhang YD (2006) FEM simulation for residual stress in quenched aeronautics aluminum alloy thickplate based on rolled residual stresses distribution. J Beijing Univ Aeronaut Astronaut 32(1):8891.
Acknowledgements
Not applicable.
Funding
This work is supported by National Key R&D Programs of China, No. 2021YFB3301302; the National Natural Science Foundation of China, No. 52175467; and the National Science Fund of China for Distinguished Young Scholars, No. 51925505.
Author information
Authors and Affiliations
Contributions
CL was responsible for the conception and design of this work; CL, YZ and ZZ developed the methodology and modelled the work; KT and DH contributed to the methodology of the work; YZ carried out literature survey and was a major contributor in writing the manuscript; CL, ZZ, KT and DH provided suggestions and revised the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Zhao, Y., Liu, C., Zhao, Z. et al. Reinforcement learning method for machining deformation control based on metainvariant feature space. Vis. Comput. Ind. Biomed. Art 5, 27 (2022). https://doi.org/10.1186/s42492022001232
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s42492022001232
Keywords
 Machining deformation
 Residual stress
 Deformation control
 Metainvariant feature space; Reinforcement learning