0.1 seconds is pretty damn fast... Keep it like you have it and you should be just fine.
(And it isn't really 0.1...it is actually >0.05 since they just have to have the key released by the next 0.05 timeframe...after that frame they can press it again even if it is at 0.06 seconds)