Of course you can go down the sheep's wool or recycled newspaper route, but here's a suggestion from Joel Rickett in a Telegraph article about home libraries, but which is equally pertinent for garden office workers. He says:
"Books are the original insulator. A shelf of books along an outside wall works well to prevent heat escaping. If all the books were removed from the homes in Britain, our energy bills would rocket."