The use of finite difference schemes to compute the scattering of acoustic waves by surfaces made up of different materials with sharp surface discontinuities at the joints would, invariably, result in the generations of spurious reflected waves. The spurious waves are caused by the use of a discrete computational method. Spurious scattered waves are produced even if a high-order scheme capable of resolving and supporting the propagation of the incident wave is used. This problem is of practical importance in jet engine duct acoustic computation. In this work, the basic reason for the generation of spurious numerical waves is first examined. A method by which high wave number components in the wave scattering process is intentionally removed so as to minimize the scattering of spurious numerical waves is proposed. This method is implemented in several examples from computational aeroacoustics to illustrate its effectiveness, accuracy and efficiency. This method is also employed to compute the scattering of acoustic waves by scatterers, such as rigid wall acoustic liner splices, with width smaller than the computational mesh size. Good results are obtained when comparing with computed results using much smaller mesh size. The method is further extended for applications to computations of acoustic wave reflection and scattering by very small surface inhomogeneities with simple geometries.