You don't say where exactly you are located... so here are a few in the LB/OC area
Clare's at the Long Beach Museum of Art is great food, really nice location and not that expensive. You eat on a patio over looking the ocean. It's only open for breakfast on the weekends.
Duke's on the Huntington Beach pier. They have a weekend brunch.
Ruby's on lots of the piers in OC (Seal Beach, Huntington, Newport, etc). It's just Ruby's but when you see dolphins, porpoises and pelicans, it doesn't feel like Ruby's.