Mass Uploading

I am looking for a way to convert a large number (~5,000) of physical
addresses into accurately placed icons on a Google map. Currently, the
addresses (number, street, city, state, zip) are saved in Excel. If
this capability is not feasible using Google Maps, I would be
interested in other software that may accomplish this task. Any
assistance and/or suggestions would be greatly appreciated.