From Computer Power User:

Freeduc-cd was the best of those looked at in the January 2005 issue.

Only works on Linux, but makes for a less expensive computer for your budding student.