The ionization process of atoms in infrared (IR) and extreme ultraviolet (XUV) two-color laser field is one of the hot topics in strong field physics. We investigate the above threshold ionization process of atoms subjected to elliptically polarized IR+XUV two-color laser fields, by employing the frequency-domain theory based on the nonperturbative quantum electrodynamics. The results show that the photoelectron energy width of each plateau can be controlled by the polarizations η1 of the IR laser. Specifically, for emission angles less than 45°, the photoelectron energy width decreases as the value η1 increases, whereas for angles more than 45°, it increases with the value η1. Furthermore, when the XUV laser changes from a linearly polarized field to a circularly polarized field, the ionization probability increases. Additionally, the energy width of photoelectrons broadens with the increase of the intensity of the IR laser, while the ionization probability increases with increasing intensity of the XUV laser, and the distance between the two plateaus increases with the increase of the frequency of the XUV laser. Meanwhile, the energy ranges of photoelectrons, as functions of emission angle, laser polarization, intensity and frequency, are predicted by using the classical energy orbital formula satisfied by electrons in the process of ionization, and these predictions are in agreement with quantum numerical results. This work provides theoretical support for the experimental study of the ionization process of atoms and molecules in IR+XUV two-color laser fields.