Here's a great article which describes how the numbers in image files get converted to colours on a screen. Along the way a range of topics from colour theory are discussed. There's some maths but you can largely ignore it and still get the gist (it starts out a bit heavy and then gets better.)
http://jamie-wong.com/post/color/
Cheers,
Rick.