In this paper, a new method for designing a reduced order observer for linear time-invariant system is proposed. The approach is based on matrix inversion with proper dimension. The arbitrariness associated with the method proposed by O'Reilly is presented here and has been reduced with the help of pole-placement technique. It also helps reducing the computations regarding the observer design parameters. Illustrative numerical examples with simulation results are also included.