In this study, a semi-Markovian random walk with Pareto distributed interference of chance and delay is considered. Some exact formulas for the first four stationary moments of the process are obtained when the random variables which express the discrete interference of chance have Pareto distribution with parameters. The random variables are interpreted as loans which insurance company gets from a bank. With the use of these exact formulas, the third-order asymptotic expansions for the first four stationary moments of the process X(t) are derived when is sufficiently large. Finally, by using Monte-Carlo simulation method, the accuracy of the obtained approximation formulas is tested.