This article presents an up-to-date tutorial review of nonlinear Bayesian estimation. State estimation for nonlinear systems has been a challenge encountered in a wide range of engineering fields, attracting decades o...This article presents an up-to-date tutorial review of nonlinear Bayesian estimation. State estimation for nonlinear systems has been a challenge encountered in a wide range of engineering fields, attracting decades of research effort. To date,one of the most promising and popular approaches is to view and address the problem from a Bayesian probabilistic perspective,which enables estimation of the unknown state variables by tracking their probabilistic distribution or statistics(e.g., mean and covariance) conditioned on a system's measurement data.This article offers a systematic introduction to the Bayesian state estimation framework and reviews various Kalman filtering(KF)techniques, progressively from the standard KF for linear systems to extended KF, unscented KF and ensemble KF for nonlinear systems. It also overviews other prominent or emerging Bayesian estimation methods including Gaussian filtering, Gaussian-sum filtering, particle filtering and moving horizon estimation and extends the discussion of state estimation to more complicated problems such as simultaneous state and parameter/input estimation.展开更多
In this paper, we consider the problem of determining the order of INAR(q) model on the basis of the Bayesian estimation theory. The Bayesian estimator for the order is given with respect to a squared-error loss funct...In this paper, we consider the problem of determining the order of INAR(q) model on the basis of the Bayesian estimation theory. The Bayesian estimator for the order is given with respect to a squared-error loss function. The consistency of the estimator is discussed. The results of a simulation study for the estimation method are presented.展开更多
In order to apply speech recognition systems to actual circumstances such as inspection and maintenance operations in industrial factories to recording and reporting routines at construction sites, etc. where hand-wri...In order to apply speech recognition systems to actual circumstances such as inspection and maintenance operations in industrial factories to recording and reporting routines at construction sites, etc. where hand-writing is difficult, some countermeasure methods for surrounding noise are indispensable. In this study, a signal detection method to remove the noise for actual speech signals is proposed by using Bayesian estimation with the aid of bone-conducted speech. More specifically, by introducing Bayes’ theorem based on the observation of air-conducted speech contaminated by surrounding background noise, a new type of algorithm for noise removal is theoretically derived. In the proposed speech detection method, bone-conducted speech is utilized in order to obtain precise estimation for speech signals. The effectiveness of the proposed method is experimentally confirmed by applying it to air- and bone-conducted speeches measured in real environment under the existence of surrounding background noise.展开更多
A modification of ranked set sampling (RSS) called maximum ranked set sampling with unequal sample (MRSSU) is considered for the Bayesian estimation of scale parameter α of the Weibull distribution. Under this method...A modification of ranked set sampling (RSS) called maximum ranked set sampling with unequal sample (MRSSU) is considered for the Bayesian estimation of scale parameter α of the Weibull distribution. Under this method, we use Linex loss function, conjugate and Jeffreys prior distributions to derive the Bayesian estimate of α. In order to measure the efficiency of the obtained Bayesian estimates with respect to the Bayesian estimates of simple random sampling (SRS), we compute the bias, mean squared error (MSE) and asymptotic relative efficiency of the obtained Bayesian estimates using simulation. It is shown that the proposed estimates are found to be more efficient than the corresponding one based on SRS.展开更多
Speech recognition systems have been applied to inspection and maintenance operations in industrial factories to recording and reporting routines at construction sites, etc. where hand-writing is difficult. In these a...Speech recognition systems have been applied to inspection and maintenance operations in industrial factories to recording and reporting routines at construction sites, etc. where hand-writing is difficult. In these actual circumstances, some countermeasure methods for surrounding noise are indispensable. In this study, a new method to remove the noise for actual speech signal was proposed by using Bayesian estimation with the aid of bone-conducted speech and fuzzy theory. More specifically, by introducing Bayes’ theorem based on the observation of air-conducted speech contaminated by surrounding background noise, a new type of algorithm for noise removal was theoretically derived. In the proposed noise suppression method, bone-conducted speech signal with the reduced high-frequency components was regarded as fuzzy observation data, and a stochastic model for the bone-conducted speech was derived by applying the probability measure of fuzzy events. The proposed method was applied to speech signals measured in real environment with low SNR, and better results were obtained than an algorithm based on observation of only air-conducted speech.展开更多
Bayesian networks (BNs) have become increasingly popular in recent years due to their wide-ranging applications in modeling uncertain knowledge. An essential problem about discrete BNs is learning conditional probabil...Bayesian networks (BNs) have become increasingly popular in recent years due to their wide-ranging applications in modeling uncertain knowledge. An essential problem about discrete BNs is learning conditional probability table (CPT) parameters. If training data are sparse, purely data-driven methods often fail to learn accurate parameters. Then, expert judgments can be introduced to overcome this challenge. Parameter constraints deduced from expert judgments can cause parameter estimates to be consistent with domain knowledge. In addition, Dirichlet priors contain information that helps improve learning accuracy. This paper proposes a constrained Bayesian estimation approach to learn CPTs by incorporating constraints and Dirichlet priors. First, a posterior distribution of BN parameters is developed over a restricted parameter space based on training data and Dirichlet priors. Then, the expectation of the posterior distribution is taken as a parameter estimation. As it is difficult to directly compute the expectation for a continuous distribution with an irregular feasible domain, we apply the Monte Carlo method to approximate it. In the experiments on learning standard BNs, the proposed method outperforms competing methods. It suggests that the proposed method can facilitate solving real-world problems. Additionally, a case study of Wine data demonstrates that the proposed method achieves the highest classification accuracy.展开更多
This paper considers the Bayesian and expected Bayesian(E-Bayesian) estimations of the parameter and reliability function for competing risk model from Gompertz distribution under Type-I progressively hybrid censoring...This paper considers the Bayesian and expected Bayesian(E-Bayesian) estimations of the parameter and reliability function for competing risk model from Gompertz distribution under Type-I progressively hybrid censoring scheme(PHCS). The estimations are obtained based on Gamma conjugate prior for the parameter under squared error(SE) and Linex loss functions. The simulation results are provided for the comparison purpose and one data set is analyzed.展开更多
A Bayesian estimation method to separate multicomponent signals with single channel observation is presented in this paper. By using the basis function projection, the component separation becomes a problem of limited...A Bayesian estimation method to separate multicomponent signals with single channel observation is presented in this paper. By using the basis function projection, the component separation becomes a problem of limited parameter estimation. Then, a Bayesian model for estimating parameters is set up. The reversible jump MCMC (Monte Carlo Markov Chain) algorithmis adopted to perform the Bayesian computation. The method can jointly estimate the parameters of each component and the component number. Simulation results demonstrate that the method has low SNR threshold and better performance.展开更多
Due to the simplicity and flexibility of the power law process,it is widely used to model the failures of repairable systems.Although statistical inference on the parameters of the power law process has been well deve...Due to the simplicity and flexibility of the power law process,it is widely used to model the failures of repairable systems.Although statistical inference on the parameters of the power law process has been well developed,numerous studies largely depend on complete failure data.A few methods on incomplete data are reported to process such data,but they are limited to their specific cases,especially to that where missing data occur at the early stage of the failures.No framework to handle generic scenarios is available.To overcome this problem,from the point of view of order statistics,the statistical inference of the power law process with incomplete data is established in this paper.The theoretical derivation is carried out and the case studies demonstrate and verify the proposed method.Order statistics offer an alternative to the statistical inference of the power law process with incomplete data as they can reformulate current studies on the left censored failure data and interval censored data in a unified framework.The results show that the proposed method has more flexibility and more applicability.展开更多
We present Bayes estimators, highest posterior density (HPD) intervals, and maximum likelihood estimators (MLEs), for the Maxwell failure distribution based on Type II censored data, i.e. using the first r lifetimes f...We present Bayes estimators, highest posterior density (HPD) intervals, and maximum likelihood estimators (MLEs), for the Maxwell failure distribution based on Type II censored data, i.e. using the first r lifetimes from a group of n components under test. Reliability/Hazard function estimates, Bayes predictive distributions and highest posterior density prediction intervals for a future observation are also considered. Two data examples and a Monte Carlo simulation study are used to illustrate the results and to compare the performances of the different methods.展开更多
Automobile insurance is one of the most popular research areas, and there are a lot of different methods for it .We uses linear empirical Bayesian estimation for the study of automobile insurance, giving the estimator...Automobile insurance is one of the most popular research areas, and there are a lot of different methods for it .We uses linear empirical Bayesian estimation for the study of automobile insurance, giving the estimator of the policy’s future claim size. Thus, a new point of view is given on the pricing of automobile insurance.展开更多
We consider the problem of population estimation using capture-recapture data, where capture probabilities can vary between sampling occasions and behavioural responses. The original model is not identifiable without ...We consider the problem of population estimation using capture-recapture data, where capture probabilities can vary between sampling occasions and behavioural responses. The original model is not identifiable without further restrictions. The novelty of this article is to expand the current research practice by developing a hierarchical Bayesian approach with the assumption that the odds of recapture bears a constant relationship to the odds of initial capture. A real-data example of deer mice population is given to illustrate the proposed method. Three simulation studies are developed to inspect the performance of the proposed Bayesian estimates. Compared with the maximum likelihood estimates discussed in Chao et al. (2000), the hierarchical Bayesian estimate provides reasonably better population estimation with less mean square error;moreover, it is sturdy to underline relationship between the initial and re-capture probabilities. The sensitivity study shows that the proposed Bayesian approach is robust to the choice of hyper-parameters. The third simulation study reveals that both relative bias and relative RMSE approach zero as population size increases. A R-package is developed and used in both data example and simulation.展开更多
The diversity of shrubs in rangelands of northern Syria is affected by the grazing management systems restricted by the increase in human and livestock populations. To describe and estimate diversity and compare the r...The diversity of shrubs in rangelands of northern Syria is affected by the grazing management systems restricted by the increase in human and livestock populations. To describe and estimate diversity and compare the rangeland grazing management treatments, two popular indices for diversity, the Shannon index and the Simpson index, were studied for the four combinations of two sites, Hammam and Obeisan, and two grazing methods, Closed and Open, using frequentist and Bayesian approaches. We simulated the a priori and a-posteriori distributions of the Shannon and Simpson diversity indices, where from a range of values for a constant in the a priori distribution the best value normalizing the distribution of the diversity indices was chosen. The Bayesian diversity estimates were higher than their frequentist counterparts and had lower standard errors. The grazing methods at each site and sites under each grazing method delivered significant diversity of shrub species. The Bayesian estimates resulted in lower p-values than the frequentist approach for two cases reflecting in Bayesian method’s higher power. Bayesian approach is recommended as it has a wider framework for inference on diversity studies.展开更多
Sentiment word embedding has been extensively studied and used in sentiment analysis tasks.However,most existing models have failed to differentiate high-frequency and low-frequency words.Accordingly,the sentiment inf...Sentiment word embedding has been extensively studied and used in sentiment analysis tasks.However,most existing models have failed to differentiate high-frequency and low-frequency words.Accordingly,the sentiment information of low-frequency words is insufficiently captured,thus resulting in inaccurate sentiment word embedding and degradation of overall performance of sentiment analysis.A Bayesian estimation-based sentiment word embedding(BESWE)model,which aims to precisely extract the sentiment information of low-frequency words,has been proposed.In the model,a Bayesian estimator is constructed based on the co-occurrence probabilities and sentiment proba-bilities of words,and a novel loss function is defined for sentiment word embedding learning.The experimental results based on the sentiment lexicons and Movie Review dataset show that BESWE outperforms many state-of-the-art methods,for example,C&W,CBOW,GloVe,SE-HyRank and DLJT1,in sentiment analysis tasks,which demonstrate that Bayesian estimation can effectively capture the sentiment information of low-frequency words and integrate the sentiment information into the word embedding through the loss function.In addition,replacing the embedding of low-frequency words in the state-of-the-art methods with BESWE can significantly improve the performance of those methods in sentiment analysis tasks.展开更多
The finite strip controlling equation of pinned curve box was deduced on basis of Novozhilov theory and with flexibility method, and the problem of continuous curve box was resolved. Dynamic Bayesian error function of...The finite strip controlling equation of pinned curve box was deduced on basis of Novozhilov theory and with flexibility method, and the problem of continuous curve box was resolved. Dynamic Bayesian error function of displacement parameters of continuous curve box was found. The corresponding formulas of dynamic Bayesian expectation and variance were derived. After the method of solving the automatic search of step length was put forward, the optimization estimation computing formulas were also obtained by adapting conjugate gradient method. Then the steps of dynamic Bayesian estimation were given in detail. Through analysis of a classic example, the criterion of judging the precision of the known information is gained as well as some other important conclusions about dynamic Bayesian stochastic estimation of displacement parameters of continuous curve box.展开更多
In this paper, we focus on a type of inverse problem in which the data are expressed as an unknown function of the sought and unknown model function (or its discretised representation as a model parameter vector). In ...In this paper, we focus on a type of inverse problem in which the data are expressed as an unknown function of the sought and unknown model function (or its discretised representation as a model parameter vector). In particular, we deal with situations in which training data are not available. Then we cannot model the unknown functional relationship between data and the unknown model function (or parameter vector) with a Gaussian Process of appropriate dimensionality. A Bayesian method based on state space modelling is advanced instead. Within this framework, the likelihood is expressed in terms of the probability density function (pdf) of the state space variable and the sought model parameter vector is embedded within the domain of this pdf. As the measurable vector lives only inside an identified sub-volume of the system state space, the pdf of the state space variable is projected onto the space of the measurables, and it is in terms of the projected state space density that the likelihood is written;the final form of the likelihood is achieved after convolution with the distribution of measurement errors. Application motivated vague priors are invoked and the posterior probability density of the model parameter vectors, given the data are computed. Inference is performed by taking posterior samples with adaptive MCMC. The method is illustrated on synthetic as well as real galactic data.展开更多
The Bayesian approach is considered as the most general formulation of the state estimation for dynamic systems.However,most of the existing Bayesian estimators of stochastic hybrid systems only focus on the Markov ju...The Bayesian approach is considered as the most general formulation of the state estimation for dynamic systems.However,most of the existing Bayesian estimators of stochastic hybrid systems only focus on the Markov jump system,few literature is related to the estimation problem of nonlinear stochastic hybrid systems with state dependent transitions.According to this problem,a new methodology which relaxes quite a restrictive assumption that the mode transition process must satisfy Markov properties is proposed.In this method,a general approach is presented to model the state dependent transitions,the state and output spaces are discreted into cell space which handles the nonlinearities and computationally intensive problem offline.Then maximum a posterior estimation is obtained by using the Bayesian theory.The efficacy of the estimator is illustrated by a simulated example.展开更多
The concept of generalized order statistics has been introduced as a unified approach to a variety of models of ordered random variables with different interpretations. In this paper, we develop methodology for constr...The concept of generalized order statistics has been introduced as a unified approach to a variety of models of ordered random variables with different interpretations. In this paper, we develop methodology for constructing inference based on n selected generalized order statistics (GOS) from inverse Weibull distribution (IWD), Bayesian and non-Bayesian approaches have been used to obtain the estimators of the parameters and reliability function. We have examined Bayes estimates under various losses such as the balanced squared error (balanced SEL) and balanced LINEX loss functions are considered. We show that Bayes estimate under balanced SEL and balanced LINEX loss functions are more general, which include the symmetric and asymmetric losses as special cases. This was done under assumption of discrete-continuous mixture prior for the unknown model parameters. The parametric bootstrap method has been used to construct confidence interval for the parameters and reliability function. Progressively type-II censored and k-record values as a special case of GOS are considered. Finally a practical example using real data set was used for illustration.展开更多
文摘This article presents an up-to-date tutorial review of nonlinear Bayesian estimation. State estimation for nonlinear systems has been a challenge encountered in a wide range of engineering fields, attracting decades of research effort. To date,one of the most promising and popular approaches is to view and address the problem from a Bayesian probabilistic perspective,which enables estimation of the unknown state variables by tracking their probabilistic distribution or statistics(e.g., mean and covariance) conditioned on a system's measurement data.This article offers a systematic introduction to the Bayesian state estimation framework and reviews various Kalman filtering(KF)techniques, progressively from the standard KF for linear systems to extended KF, unscented KF and ensemble KF for nonlinear systems. It also overviews other prominent or emerging Bayesian estimation methods including Gaussian filtering, Gaussian-sum filtering, particle filtering and moving horizon estimation and extends the discussion of state estimation to more complicated problems such as simultaneous state and parameter/input estimation.
文摘In this paper, we consider the problem of determining the order of INAR(q) model on the basis of the Bayesian estimation theory. The Bayesian estimator for the order is given with respect to a squared-error loss function. The consistency of the estimator is discussed. The results of a simulation study for the estimation method are presented.
文摘In order to apply speech recognition systems to actual circumstances such as inspection and maintenance operations in industrial factories to recording and reporting routines at construction sites, etc. where hand-writing is difficult, some countermeasure methods for surrounding noise are indispensable. In this study, a signal detection method to remove the noise for actual speech signals is proposed by using Bayesian estimation with the aid of bone-conducted speech. More specifically, by introducing Bayes’ theorem based on the observation of air-conducted speech contaminated by surrounding background noise, a new type of algorithm for noise removal is theoretically derived. In the proposed speech detection method, bone-conducted speech is utilized in order to obtain precise estimation for speech signals. The effectiveness of the proposed method is experimentally confirmed by applying it to air- and bone-conducted speeches measured in real environment under the existence of surrounding background noise.
文摘A modification of ranked set sampling (RSS) called maximum ranked set sampling with unequal sample (MRSSU) is considered for the Bayesian estimation of scale parameter α of the Weibull distribution. Under this method, we use Linex loss function, conjugate and Jeffreys prior distributions to derive the Bayesian estimate of α. In order to measure the efficiency of the obtained Bayesian estimates with respect to the Bayesian estimates of simple random sampling (SRS), we compute the bias, mean squared error (MSE) and asymptotic relative efficiency of the obtained Bayesian estimates using simulation. It is shown that the proposed estimates are found to be more efficient than the corresponding one based on SRS.
文摘Speech recognition systems have been applied to inspection and maintenance operations in industrial factories to recording and reporting routines at construction sites, etc. where hand-writing is difficult. In these actual circumstances, some countermeasure methods for surrounding noise are indispensable. In this study, a new method to remove the noise for actual speech signal was proposed by using Bayesian estimation with the aid of bone-conducted speech and fuzzy theory. More specifically, by introducing Bayes’ theorem based on the observation of air-conducted speech contaminated by surrounding background noise, a new type of algorithm for noise removal was theoretically derived. In the proposed noise suppression method, bone-conducted speech signal with the reduced high-frequency components was regarded as fuzzy observation data, and a stochastic model for the bone-conducted speech was derived by applying the probability measure of fuzzy events. The proposed method was applied to speech signals measured in real environment with low SNR, and better results were obtained than an algorithm based on observation of only air-conducted speech.
基金supported by the National Natural Science Foundation of China(61573285)the Innovation Foundation for Doctor Dissertation of Northwestern Polytechnical University,China(CX201619)
文摘Bayesian networks (BNs) have become increasingly popular in recent years due to their wide-ranging applications in modeling uncertain knowledge. An essential problem about discrete BNs is learning conditional probability table (CPT) parameters. If training data are sparse, purely data-driven methods often fail to learn accurate parameters. Then, expert judgments can be introduced to overcome this challenge. Parameter constraints deduced from expert judgments can cause parameter estimates to be consistent with domain knowledge. In addition, Dirichlet priors contain information that helps improve learning accuracy. This paper proposes a constrained Bayesian estimation approach to learn CPTs by incorporating constraints and Dirichlet priors. First, a posterior distribution of BN parameters is developed over a restricted parameter space based on training data and Dirichlet priors. Then, the expectation of the posterior distribution is taken as a parameter estimation. As it is difficult to directly compute the expectation for a continuous distribution with an irregular feasible domain, we apply the Monte Carlo method to approximate it. In the experiments on learning standard BNs, the proposed method outperforms competing methods. It suggests that the proposed method can facilitate solving real-world problems. Additionally, a case study of Wine data demonstrates that the proposed method achieves the highest classification accuracy.
基金supported by the National Natural Science Foundation of China(7117116471401134+1 种基金71571144)the Natural Science Basic Research Program of Shaanxi Province(2015JM1003)
文摘This paper considers the Bayesian and expected Bayesian(E-Bayesian) estimations of the parameter and reliability function for competing risk model from Gompertz distribution under Type-I progressively hybrid censoring scheme(PHCS). The estimations are obtained based on Gamma conjugate prior for the parameter under squared error(SE) and Linex loss functions. The simulation results are provided for the comparison purpose and one data set is analyzed.
文摘A Bayesian estimation method to separate multicomponent signals with single channel observation is presented in this paper. By using the basis function projection, the component separation becomes a problem of limited parameter estimation. Then, a Bayesian model for estimating parameters is set up. The reversible jump MCMC (Monte Carlo Markov Chain) algorithmis adopted to perform the Bayesian computation. The method can jointly estimate the parameters of each component and the component number. Simulation results demonstrate that the method has low SNR threshold and better performance.
基金supported by the National Natural Science Foundation of China(51775090)。
文摘Due to the simplicity and flexibility of the power law process,it is widely used to model the failures of repairable systems.Although statistical inference on the parameters of the power law process has been well developed,numerous studies largely depend on complete failure data.A few methods on incomplete data are reported to process such data,but they are limited to their specific cases,especially to that where missing data occur at the early stage of the failures.No framework to handle generic scenarios is available.To overcome this problem,from the point of view of order statistics,the statistical inference of the power law process with incomplete data is established in this paper.The theoretical derivation is carried out and the case studies demonstrate and verify the proposed method.Order statistics offer an alternative to the statistical inference of the power law process with incomplete data as they can reformulate current studies on the left censored failure data and interval censored data in a unified framework.The results show that the proposed method has more flexibility and more applicability.
文摘We present Bayes estimators, highest posterior density (HPD) intervals, and maximum likelihood estimators (MLEs), for the Maxwell failure distribution based on Type II censored data, i.e. using the first r lifetimes from a group of n components under test. Reliability/Hazard function estimates, Bayes predictive distributions and highest posterior density prediction intervals for a future observation are also considered. Two data examples and a Monte Carlo simulation study are used to illustrate the results and to compare the performances of the different methods.
文摘Automobile insurance is one of the most popular research areas, and there are a lot of different methods for it .We uses linear empirical Bayesian estimation for the study of automobile insurance, giving the estimator of the policy’s future claim size. Thus, a new point of view is given on the pricing of automobile insurance.
文摘We consider the problem of population estimation using capture-recapture data, where capture probabilities can vary between sampling occasions and behavioural responses. The original model is not identifiable without further restrictions. The novelty of this article is to expand the current research practice by developing a hierarchical Bayesian approach with the assumption that the odds of recapture bears a constant relationship to the odds of initial capture. A real-data example of deer mice population is given to illustrate the proposed method. Three simulation studies are developed to inspect the performance of the proposed Bayesian estimates. Compared with the maximum likelihood estimates discussed in Chao et al. (2000), the hierarchical Bayesian estimate provides reasonably better population estimation with less mean square error;moreover, it is sturdy to underline relationship between the initial and re-capture probabilities. The sensitivity study shows that the proposed Bayesian approach is robust to the choice of hyper-parameters. The third simulation study reveals that both relative bias and relative RMSE approach zero as population size increases. A R-package is developed and used in both data example and simulation.
文摘The diversity of shrubs in rangelands of northern Syria is affected by the grazing management systems restricted by the increase in human and livestock populations. To describe and estimate diversity and compare the rangeland grazing management treatments, two popular indices for diversity, the Shannon index and the Simpson index, were studied for the four combinations of two sites, Hammam and Obeisan, and two grazing methods, Closed and Open, using frequentist and Bayesian approaches. We simulated the a priori and a-posteriori distributions of the Shannon and Simpson diversity indices, where from a range of values for a constant in the a priori distribution the best value normalizing the distribution of the diversity indices was chosen. The Bayesian diversity estimates were higher than their frequentist counterparts and had lower standard errors. The grazing methods at each site and sites under each grazing method delivered significant diversity of shrub species. The Bayesian estimates resulted in lower p-values than the frequentist approach for two cases reflecting in Bayesian method’s higher power. Bayesian approach is recommended as it has a wider framework for inference on diversity studies.
基金Funding information National Statistical Science Research Project of China,Grant/Award Number:2016LY98Science and Technology Department of Guangdong Province in China,Grant/Award Numbers:2016A010101020,2016A010101021,2016A010101022+2 种基金Characteristic Innovation Projects of Guangdong Colleges and Universities,Grant/Award Numbers:2018KTSCX049,2018GKTSCX069Science and Technology Plan Project of Guangzhou,Grant/Award Numbers:201802010033,201903010013Bidding Project of Laboratory of Language Engineering and Computing of Guangdong University of Foreign Studies,Grant/Award Number:LEC2019ZBKT005。
文摘Sentiment word embedding has been extensively studied and used in sentiment analysis tasks.However,most existing models have failed to differentiate high-frequency and low-frequency words.Accordingly,the sentiment information of low-frequency words is insufficiently captured,thus resulting in inaccurate sentiment word embedding and degradation of overall performance of sentiment analysis.A Bayesian estimation-based sentiment word embedding(BESWE)model,which aims to precisely extract the sentiment information of low-frequency words,has been proposed.In the model,a Bayesian estimator is constructed based on the co-occurrence probabilities and sentiment proba-bilities of words,and a novel loss function is defined for sentiment word embedding learning.The experimental results based on the sentiment lexicons and Movie Review dataset show that BESWE outperforms many state-of-the-art methods,for example,C&W,CBOW,GloVe,SE-HyRank and DLJT1,in sentiment analysis tasks,which demonstrate that Bayesian estimation can effectively capture the sentiment information of low-frequency words and integrate the sentiment information into the word embedding through the loss function.In addition,replacing the embedding of low-frequency words in the state-of-the-art methods with BESWE can significantly improve the performance of those methods in sentiment analysis tasks.
文摘The finite strip controlling equation of pinned curve box was deduced on basis of Novozhilov theory and with flexibility method, and the problem of continuous curve box was resolved. Dynamic Bayesian error function of displacement parameters of continuous curve box was found. The corresponding formulas of dynamic Bayesian expectation and variance were derived. After the method of solving the automatic search of step length was put forward, the optimization estimation computing formulas were also obtained by adapting conjugate gradient method. Then the steps of dynamic Bayesian estimation were given in detail. Through analysis of a classic example, the criterion of judging the precision of the known information is gained as well as some other important conclusions about dynamic Bayesian stochastic estimation of displacement parameters of continuous curve box.
文摘In this paper, we focus on a type of inverse problem in which the data are expressed as an unknown function of the sought and unknown model function (or its discretised representation as a model parameter vector). In particular, we deal with situations in which training data are not available. Then we cannot model the unknown functional relationship between data and the unknown model function (or parameter vector) with a Gaussian Process of appropriate dimensionality. A Bayesian method based on state space modelling is advanced instead. Within this framework, the likelihood is expressed in terms of the probability density function (pdf) of the state space variable and the sought model parameter vector is embedded within the domain of this pdf. As the measurable vector lives only inside an identified sub-volume of the system state space, the pdf of the state space variable is projected onto the space of the measurables, and it is in terms of the projected state space density that the likelihood is written;the final form of the likelihood is achieved after convolution with the distribution of measurement errors. Application motivated vague priors are invoked and the posterior probability density of the model parameter vectors, given the data are computed. Inference is performed by taking posterior samples with adaptive MCMC. The method is illustrated on synthetic as well as real galactic data.
基金supported by the National Natural Science Foundation of China (6097400161104121)the Fundamental Research Funds for the Central Universities (JUDCF11039)
文摘The Bayesian approach is considered as the most general formulation of the state estimation for dynamic systems.However,most of the existing Bayesian estimators of stochastic hybrid systems only focus on the Markov jump system,few literature is related to the estimation problem of nonlinear stochastic hybrid systems with state dependent transitions.According to this problem,a new methodology which relaxes quite a restrictive assumption that the mode transition process must satisfy Markov properties is proposed.In this method,a general approach is presented to model the state dependent transitions,the state and output spaces are discreted into cell space which handles the nonlinearities and computationally intensive problem offline.Then maximum a posterior estimation is obtained by using the Bayesian theory.The efficacy of the estimator is illustrated by a simulated example.
文摘The concept of generalized order statistics has been introduced as a unified approach to a variety of models of ordered random variables with different interpretations. In this paper, we develop methodology for constructing inference based on n selected generalized order statistics (GOS) from inverse Weibull distribution (IWD), Bayesian and non-Bayesian approaches have been used to obtain the estimators of the parameters and reliability function. We have examined Bayes estimates under various losses such as the balanced squared error (balanced SEL) and balanced LINEX loss functions are considered. We show that Bayes estimate under balanced SEL and balanced LINEX loss functions are more general, which include the symmetric and asymmetric losses as special cases. This was done under assumption of discrete-continuous mixture prior for the unknown model parameters. The parametric bootstrap method has been used to construct confidence interval for the parameters and reliability function. Progressively type-II censored and k-record values as a special case of GOS are considered. Finally a practical example using real data set was used for illustration.
