Ultrasonic nondestructive testing of large grained materials is limited by the ability of the detection process to distinguish the flaw signals from the backscattered grain boundary echoes. This coherent grain noise often masks the echo from inhomogeneities and defects in the material. Absorption and scattering effects further reduce the ultrasound energy leading to poor signal-to-noise ratio in the received signal. It is not possible to reduce the grain clutter by conventional time averaging techniques due to its coherent nature. Different algorithms utilizing the principles of frequency diversity and spatial diversity have been used in the past for signal-to-noise ratio enhancement. In NDE applications where the noise is primarily due to Rayleigh scattering, it can be shown that flaw detection can be improved significantly by merely bandpass filtering the lower part of the received wideband echo spectrum. Both theoretical and experimental results are presented to support this conclusion. The filtering technique is successfully tested on materials with different grain sizes. The main advantage of this method is its relative simplicity, which eliminates the need for sophisticated and computationally intensive signal processing algorithms. Furthermore, this technique allows simple hardware implementation for real-time applications. The optimal parameters, i.e., the center frequency and bandwidth of the bandpass filter are experimentally determined.