Introduction A Markov chain is a mathematical model that describes a system evolving over time among a finite number of states. This model is based on the assumption that the future state of the system depends only on the current state and not on previous states, the so-called Markov property. In the context of financial markets, Markov chains can be used to...
Library "MarkovAlgorithm" Markov algorithm is a string rewriting system that uses grammar-like rules to operate on strings of symbols. Markov algorithms have been shown to be Turing-complete, which means that they are suitable as a general model of computation and can represent any mathematical expression from its simple notation. ~...
Library "MarkovChain" Generic Markov Chain type functions. --- A Markov chain or Markov process is a stochastic model describing a sequence of possible events in which the probability of each event depends only on the state attained in the previous event. --- reference: Understanding Markov Chains, Examples and Applications. Second Edition. Book by Nicolas...
Library "FunctionProbabilityViterbi" The Viterbi Algorithm calculates the most likely sequence of hidden states *(called Viterbi path)* that results in a sequence of observed events. viterbi(observations, transitions, emissions, initial_distribution) Calculate most probable path in a Markov model. Parameters: observations (int ) : array ....
Library "FunctionBaumWelch" Baum-Welch Algorithm, also known as Forward-Backward Algorithm, uses the well known EM algorithm to find the maximum likelihood estimate of the parameters of a hidden Markov model given a set of observed feature vectors. --- ### Function List: > `forward (array pi, matrix a, matrix b, array obs)` > `forward (array pi, matrix a,...
Library "FunctionSMCMC" Methods to implement Markov Chain Monte Carlo Simulation (MCMC) markov_chain(weights, actions, target_path, position, last_value) a basic implementation of the markov chain algorithm Parameters: weights : float array, weights of the Markov Chain. actions : float array, actions of the Markov Chain. target_path : float...
Library "FunctionDecisionTree" Method to generate decision tree based on weights. decision_tree(weights, depth) Method to generate decision tree based on weights. Parameters: weights : float array, weights for decision consideration. depth : int, depth of the tree. Returns: int array
Example function of a markov chain monte carlo simulation.