The Swarm mission consists of three satellites orbiting the Earth at low orbital altitudes. The onboard GPS receivers, star cameras, and laser retro-reflectors make the Swarm mission an interesting candidate to explore the contribution of Swarm GPS data to the recovery of both the static and time-variable gravity fields. We use 1.5 years of Swarm GPS and attitude data to generate kinematic positions of high quality to perform gravity field determination using the Celestial Mechanics Approach. The generated gravity fields reveal severe systematic errors along the geomagnetic equator. Their size is correlated with the ionospheric density and thus strongly varying over the analyzed time period. Similar to the findings of the GOCE mission, the systematic errors are related to the Swarm GPS carrier phase data and may be reduced by rejecting GPS data affected by large ionospheric changes. Such a measure yields a strong reduction of the systematic errors along the geomagnetic equator in the gravity field recovery. Long wavelength signatures of the gravity field may then be recovered with a similar quality as achieved with GRACE GPS data, which makes the Swarm mission well suited to bridge a potential gap between the current GRACE and the future GRACE Follow-On mission.