Good point, good point. Unless you call in sick for the funeral (perhaps a good move) you'll be grilled by someone, but whom? The ones who liked him will want you to be sad, the ones who hated him will want you to be quiet-- perhaps you can find a happy medium and avoid the ire of both parties. And I suppose that if someone questions your motivations, especially if you choose to be quiet, then you can simply state that he abused you and you'd rather not participate. But of course, Fe isn't my strong suit, so take this advice with a grain of salt.
-Duxwing