In this paper we consider the issue of designing a single Gabor filter for multiple texture segmentation using a systematic optimization algorithm. The proposed algorithm is a stochastic search technique based on the simulated annealing (SA) procedure. It embeds the pattern search into the SA procedure as the move generation mechanism to accelerate the search. The selection objective for a best Gabor filter is based on the Maxmin principle that maximizes the minimum energy ratio of any two distinct textures in question. The objective makes the energy responses between different texture classes well separated. Therefore, a simple thresholding scheme can be directly applied to partition an input image into differently textured regions. The experiments on a number of bipartite, tripartite and quadripartite textured images have shown promising results using the proposed method.