How should hypothetical problem-solving exercises be approached?

Students are traditionally given problem-solving exercises by their instructors,  as assignments, tests or exams.  It is essential to learn strategies and methodologies for dealing with such exercises.