Thats a tricky one I am told. I believe there is a certain or special hone for keywayed holes ??
You could always set it up on a mill,indicate the head then use a boring head and take half a thou off, Ive seen it done before by a really good machinist.