You can use BatchGeo to create maps in Google Maps using a set of information from an Excel spreadsheet. It’s pretty easy.
But if you want to use Google Maps directly here’s a short video from Google. (It’s a bit slower than the BatchGeo method.) They should know this stuff, right?