Markov decision process-based support tool for reservoir development planning

摘要

A Markov decision process-based support tool for reservoir development planning can comprise a source of input data, an optimization model, a high fidelity model for simulating the reservoir, and one or more solution routines interfacing with the optimization model. The optimization model can consider unknown parameters having uncertainties directly within the optimization model. The model incorporates the flexibility that a decision-maker has in the real world and allows the decision-maker to adjust the decisions based on new information. The model can systematically address uncertain data, for example comprehensively or even taking all uncertain data into account. Accordingly, the optimization model can provide flexible or robust solutions that remain feasible over an uncertainty space. Once the reservoir model is optimized, final development plans may be generated.

主权项

1. A method for reservoir development planning, comprising the steps of:
receiving data relevant to reservoir development; processing the received data by using a computer-implemented Markov decision process-based model, wherein the using the computer-implemented Markov decision process-based model includes defining a plurality of stages, each stage representing a discrete step in time; defining a plurality of states in each stage, each state representing a potential state of the reservoir development plan, and determining a future state by using a probability that the reservoir development transitions from a current state in a current stage to the future state in a subsequent stage, the probability being determined by the current state of the reservoir development and an action to be taken in the current stage that causes the transition to the subsequent stage; and generating a reservoir development plan in response to processing the received data via the computer-implemented Markov decision process-based model.