My boss, the CEO of the company I work for, pulled me aside and said, "I admire and respect your opinon. You are an intelligent and thoughtful person...". He then asked me for advice and insight on firing a fellow employee.
Why do they always come to me for sage-like advice?
It's a tad obvious, don't you think? They've identified you as being an intelligent, thoughtful fellow whose opinion they admire and respect, which makes you the go to guy for situations that they're unsure about.
If I were you I would ask whether they're coming to you to actually solve the problem, or whether they're coming to you for reassurance about a decision they've already made, perhaps for a few tips on how to execute it properly or to identify land mines that they might have missed.
I personally think that if your CEO has come to you and spoken to you with that kind of language, that playing dumb from here on out isn't going to work, because it's incongruent with the rest of their perception of you.
I think that the main risk for you is that others may take your advice merely because you said it, and if things go wrong, blame you for making a bad choice - so imo it's important that you communicate that the decision is theirs, but that you will analyse the situation wholistically and outline the pros/cons of different strategies.
When this happens to me (and it does often because Im also the go to guy for a lot of people) I usually start the chat with the line "Im going to say what I think and why I think it, but at the end of the day, it really is up to you and I don't have all of the information" - then I go through the different options, the costs/benefits of each, the risks involved, and then I always ask "what do you think about all of that? does it make sense to you or am I on crazy pills?".
Does that make sense?
(see. hehe)