Is your secret question really secret?
Take a look at this article: 'Secret' Questions Leave Accounts Vulnerable, now ask yourself: Could someone guess the answer to your secret question. I have always felt that these secret questions were silly and I usually have not utilize them. I structure my passwords in such a way that they are difficult to guess and difficult for me to forget.
The article recommends that use of several trusted friends and describes the process. A simple test of the trusted friend process indicates that 90% of the people who used trusted friends instead of secret questions were successful in resetting their password successfully.
Keeping your email account secure is very important. This article: 'Secret' Questions Leave Accounts Vulnerable is certainly worth the read.