I haven't had problems spec'ing out an o-ring, but my block isn't built yet
I can outline it all (searching for notes...)
Here are some of the considerations:
1-Your channels must be smooth (if you sandblasted them, you're scre*ed). You can compensate for this with a softer o-ring (durometer rating).
#2-The channel must be wider than the ring, and the ring must sit perfectly in the middle of it. This of course applies nicely to round seals, but I believe that in your case, it's not; you'll have to calculate the length of the center of your channel, and make sure that it matches your o-ring.
I've got a couple more notes to add, but it'll have to wait... One thing at a time!