Actually on the Royal Mile. You can take the bike a few minutes down the Royal Mile, past Holyrood Palace and into Queens Park and then Arthurs Seat.
For a longer ride, North Berwick is great fun. Its 25 miles, flat and has great fish and chips when you get there. I usually get train home. Maps available.