Sounds like you are trying to render a heavy model file. I agree that saving and restarting SU will probably help. I have found that with these issues, VRay clears reflections and some alpha map settings when you get this error. You should go through your materials list and verify that this has not happened, the re-render.