In gravity interpretation methods, an initial guess for the approximate shape of the gravity source is necessary. In this paper, the support vector classifier (SVC) is applied for this duty by using gravity data. It is shown that using SVC leads us to estimate the approximate shapes of gravity sources more objectively. The procedure of selecting correct features is called feature selection (FS). In this research, the proper features are selected using inter/intra class distance algorithm and also FS is optimized by increasing and decreasing the number of dimensions of features space. Then, by using the proper features, SVC is used to estimate approximate shapes of sources from the six possible shapes, including: sphere, horizontal cylinder, vertical cylinder, rectangular prism, syncline, and anticline. SVC is trained using 300 synthetic gravity profiles and tested by 60 other synthetic and some real gravity profiles (related to a well and two ore bodies), and shapes of their sources estimated properly.