Hey Brooks,
No, there is no chemical that will affect epoxy so you can remove it.
The safest way is to use a hairdryer to gently heat the epoxy and then work it off with your thumbnail. You could use a heat gun, but you would need to be extremely judicious in the application of that much heat, as you can seriously damage the graphite and the resins that hold it together.
A razor blade is a reasonable choice, however, as you mentioned, you need to be very cautious and not damage the blank. You might get into the finish a bit, but this is OK as long as you are putting the guides back in the exact same location.
Whichever way you choose, take your time and enjoy the process. If you have any other questions feel free to e-mail me directly at:
This e-mail address is being protected from spam bots, you need JavaScript enabled to view it
Buzz