Is it normal for a programmer to sit and just thinking or do something which is totally irrelevant?

and if my boss come cynical about whether I spend my time in productive manner or not what would be the verdict. and if my boss indicate his doubts with questions likewise "what are you working on" then how should it be responded