I am really thinking this is a Maya Mental Ray issue as we have been have
had some issues with Batch rendering too lately after Batch was being
really well behaved. Now Batch is being flaky and Rush is being well
behaved, go figure.
1. the rendering issue would show up on all the systems so they would all
render bad frames. Rendering Batch locally sometimes it worked and
sometimes it would say it rendered fine but not render even a single
frame. Maya Software renders perfectly every time both on the farm and
batch.
2. Can't really replicate it consistently, seems to happen at random
3. Yes, 4 instances per machine
4. I will give this a try and let you know, this week all my tests files
have been rendering fine on the farm, go figure. I have not made any
changes to the nodes or rush settings.
5. scanline errors, the image is completely corrupted. All you would see
if white irregular horizontal lines. We were only submitted one job at a
time since we were having issues but I got it to happen with a local batch
render too. Rush would render all the frames this way, the local Batch
render would try and render every frame to the same file. Once again looks
like a bug in the maya/mental ray side of things.
As soon as I get this job off my plate I will run a bunch of tests and try
and really figure out what is going on. Maybe Maya 2012 coming on in a
couple days fixes our rendering issues, or just creates a whole new group
of problems, haha.
Thanks!
On Mon, 28 Mar 2011 17:41:20 -0700, Greg Ercolano <erco@(email surpressed)> wrote:
Jeffrey Jasper wrote:
[posted to rush.general]
This one is stumping me. We have been having a lot of weird Maya 2011
mental ray rendering issues. But rendering on our rush farm seemed more
reliable till we upgraded to 2011. I even patched to 2011.5 and am still
having issues.
Local render render fine. If I submit them to the Rush queue all frames
will render with no errors. At first we got some renders where it looked
like textures had shifted around on the object. Then we got some where
the
frame only had some white horizontal lines going through the image
files.
If I set a scene to render on one of the nodes from the Maya interface
it
all renders fine.
Can you email me directly (do not post to the group) your .common.pl
and submit-maya script you're using?
Some other info:
1) Does the problem happen only on particular machines,
or is it random? (ie. if you re-render that same frame on
the machine it rendered badly, it works fine the second time?)
2) Can you replicate the problem easily, or does it happen
infrequently?
3) Does more than one instance of maya/mray run on a machine
at a time? (depends on the combo of your rush/etc/hosts file
settings and/or your Cpus: specification)
4) Try telling rush to render the job on one render node
(ie. Cpus: somehost=1)
Does that render OK?
If so, then try adding more processors to the job until
the problem starts happening. (Try limiting the job to only
use one instance per machine on many machines, vs multiple
instances on one machine)
See if you can find a pattern.
5) You mentioned some white horizontal lines through the image.
Are these 'scanline errors' that seem to run through the entire
image, as if the image was corrupt, or does the line follow
geometry (ie. cracks in texturemaps or at geometry boundaries)
If scanline errors, sounds like a problem writing to the
file server; make sure you don't have a situation where two
or more jobs are rendering the same frame at the same time
(ie. a left over job is still running while the same job
is resubmitted again), or check your file server and client
system logs to see if the network file system is choking.
at around the same time the images in question were being rendered,
to see if there's file system corruptions due to network or server
load.
--
Using Opera's revolutionary email client: http://www.opera.com/mail/
|