Ultrasonics constitute a commonly applied nondestructive technique for inspection of austenitic welds and claddings. However, the complex microstructures present in these components lead to complicated ultrasound propagation paths. In this respect, mathematical modeling has evolved as an important tool providing assisting analysis and optimized experimental set-ups. The prediction of ultrasonic signals is aggravated by the anisotropic material properties and — additionally — the inhomogeneous crystallite arrangement. Thus, many modeling techniques suffer from large computation times, a problem that is even more critical when the inhomogeneity is also taken into account. In this contribution, a computationally fast modeling code using Gaussian beam superposition is presented, which is based on the formulation presented recently for homogeneous anisotropic materials [1]. The inhomogeneity is modeled by dividing the weldment into several layers of respective grain orientation, the approach accounting for the propagation through the isotropic/anisotropic layers and the reflection/refraction processes at the interfaces. It thus calculates ultrasonic field patterns including proper amplitude information and allows for a fast evaluation of the sound fields generated e.g. by commercial angle beam transducers. With emphasis on (quasi-) longitudinal and shear horizontal wave propagation, results are shown for two different weld configurations.