Python is an alternative, especially within the Sage package .
Then there is also Maxima .
Will check out Sage, haven't used Maxima since 2004. Thanks!
Edit: Sage looks nifty, Maxima looks unchanged, at least at screenshot-level.
Octave is more of an open source Matlab equivalent. That is, mostly linear algebra.