Baltimore was a quick 30 minute drive north of Annapolis and we spent most of the day Friday and Saturday there. We booked a room through HI Hostels and stayed in their hostel, which was downtown and not too far from the Inner Harbor area. The accommodations were decent (although hot) and provided the basics we needed: a bed to sleep in, a bathroom to shower, and a place to park our car. We didn't spend much time in the hostel but they seem to do a good job of providing resources and things to do for guests and I'd definitely consider using them again when we travel to other cities where H.I. offers accommodations.
In all, it was a great getaway for us. The weather ended up being nice and we were able to see many different things. We hope to get back sometime and see even more!