Search the courses, subjects, tracks, games and features, or jump straight to a page.
5 cards from this section. Quick, good the night before a test.
What is double precision arithmetic?
Think about how numbers are stored in a computer.
Define numerical precision.
Refer to factors influencing computational accuracy.
What problem is caused by floating-point roundoff errors?
Think about the challenges in computations.
True or False: Double precision means increased accuracy due to more bits being used.
Recall the difference between double and single precision.
Given a nearly singular matrix, describe how you would compute its eigenvectors while ensuring accuracy.
Consider what tools or software you might employ.
In a simulation, you identify significant sensitivity in results due to rounding errors. Suggest a set of steps to improve the situation.
Address the problem iteratively.
5 more questions in this section. Enroll free to practise them all.
Enroll free