 dhiguva paerkonna prakaaram ,  markov nirnaya procedure emti ?
 ganithamloo ,  markov desition prosess  (MDP)  anede vivikta - same yaadruchhika niyanthrana procedure .  phalitaalu pakshikanga yadruchikamga mariyu pakshikanga nirnayaadhikaarula niyantranalo unna paristhitulloo modaling nirnayam teesukoovadaaniki idi ganita chatraanni andistundi .  dynamic prograaming dwara parishkarinchabadina optimization samasyalanu adhyayanam cheyadanki  MDP lu upayogapadataai . MDP lu kanisam  1950 l natiki telisinavi ;  roonald howard yokka  1960  pustakam ,  dynamic prograaming mariyu markov processes nundi markov nirnaya prakriyalapai parisoedhana yokka pradhaana bhaagam .  avi roobootiks ,  automatic control ,  ecanamics mariyu manufacturing ‌ thoo sahaa anek vibhaagaalalo upayoginchabadataayi . MDP l peruu rashyan ganita saastrajnudu andrei markov nundi vacchindi ,  endhukante avi markov golusula podiginpu .
 markov desition prosess  (MDP)  anede phalitaalu purtiga nirnayaadhikaarula niyantranalo laeni sandarbhaalalo modaling nirnayam teesukoovadaaniki ooka ganita chatram . MDP lu roobootiks mariyu ecanamics vento vividha vibhaagaalalo upayoginchabadataayi .