103.07 (Fixes/Features) 05/21/15
_______________________________________________________________________________
RUSH
o Sped up 'rush' cli startup time when one or more hosts won't resolve in rush/etc/hosts file
The new fast hostname lookup code was causing all hosts in the hosts file
to be resolved, and this was on even for the 'rush' application code.
o Speed up 'rush' frame startup times
Changed how internal 'Intermediate Process' works to prevent triggering
unneeded rush.conf + hosts file loads.
O 'rush -push' fixed a bug with how files are pushed
Problem would show up intermittently where 'rush -push' could sometimes give the error:
somehost[hosts]: 'push hosts' failed: client sent #####, server got uncompressed size #####
..where the "#####" values are not the same. (Off by one or more)
The fix should solve this problem. (GENER8/H.YANG 04/06/15)
o 'rush -laj' and 'rush -lac': defers bad hostname lookup errors
to /end/ of report, so as not to screw up irush "All Jobs"/"All Cpus"
report headers
o 'rush -tasklist' added -x flag for 'extra info'.
Currently this includes "[This host cpus=0]" in the NOTES field
if the machine's cpus are disabled.
o Removed rush_eval scripts
RUSHTOP
o Fixed problem introduced in 103.05 where resizing/repositioning the
rushtop window would loose the scroll position. Fixed in 103.07.
IRUSH
o Fix "Jobs -> Requeue Job's.. -> frames" menu item to instead read ".. -> All Frames"
o Fix subtle problem with '# items selected' counter not always showing up during a selection
(Had to click+release on one item first, then drag selection would work)
o irush can now find columns by their header names now, instead
of position-specific. This helps your custom reports be able to
reposition columns for Jobid/Status/Frame without breaking irush
features such as report coloring or double-clicking jobs to
pick them. Header names are used to find fields now, and will
match regardless of case (e.g. "FRAME" or "Frame" will work)
PYTHON SCRIPTS
o submit_afterfx.py: added, with shotgun support, python2+3
o submit_maya.py: added shotgun support, python2+3
o submit_timeshaper.py: added
o submit_stereoid.py: added
o submit_terragen.py: added
o Application wrapper checks if #! line of python scripts
include the -B flag, and if so, set that flag during invocation,
to allow prevention of .pyc file creation
o Added rush-gui-tail tool to aid in debugging shotgun background tasks.
Tails log files, includes optional color coded line match patterning.
o TODO: python2+3 conversion of all submit scripts
o Ran 'pychecker' on all python code, applied fixes
INTERNALS
o MyFile class: removed dependence on rush.conf and rush hosts
(so it can be used by new IntermediateProcess class)
103.06 BUILD 03/24/15 (Fixes/Features) 03/24/15
_______________________________________________________________________________
RUSH
o Fixed threading bug with cpuacct.dbasedir
This caused daemons to crash while writing logs to the server.
With older 103 versions (before the fix), avoid configuring the
rush.conf cpuacct.dbasedir command to write to a server if you are
experiencing problems with daemons crashing. e.g.
======= Backtrace: =========
/lib64/libc.so.6[0x3e57076126]
/lib64/libc.so.6[0x3e57079ba4]
/lib64/libc.so.6(__libc_malloc+0x71)[0x3e5707a951]
/usr/local/rush/bin/rushd[0x4821a1] -- MALLOC
/usr/local/rush/bin/rushd[0x485527] -- STRING APPEND
/usr/local/rush/bin/rushd[0x485f8a] -- STRING
/usr/local/rush/bin/rushd[0x550cb6] -- AcctNetlogWriteToServer::String
/usr/local/rush/bin/rushd[0x551555] -- AcctNetlogWriteToServer::List_String
/usr/local/rush/bin/rushd[0x551f03] -- AcctNetlog::ChildThread
/lib64/libpthread.so.0[0x3e57807851]
/lib64/libc.so.6(clone+0x6d)[0x3e570e894d]
o 'rush -status': if swap data unavailable (e.g. Tiger),
show all zeroes for 'S' (instead of an 'X' error)
o rush -status: hostname lookup errors in rush/etc/hosts file
no longer prevent multihost reports from completing.
o Made some changes to many of the rush command flags to make sure
hostname lookup errors in the rush/etc/hosts file don't prevent
entire reports from being printed. (Added a new -foe flag (Fail On Error)
to enable this if desired) This was preventing rushtop from working if
one or more hosts in rush/etc/hosts didn't have proper IP lookups.
RUSHTOP
o Fixed a problem where rushtop would show "END OF DATA" if one or more
hosts in the +any group have bad IP lookups (i.e. not configured in DNS).
o Errors with hostname lookups are shown inside the rushtop interface
o Small cosmetic mods to how errors are shown inside rushtop
o Font size changes (+/-) affect error messages too
o Shows red 'X' for swap if swap data unavailable
o Ctrl-click can post popup menu (for one button mouse)
IRUSH
o Hotkeys now have their own column width 'memory' for each hotkey report.
So if you create three different custom Jobs reports, each with special
columns of data, resizing the columns in one report won't affect the
column sizes in the other. Changes are saved so when you reopen irush,
the column widths are remembered.
o Fixed some broken documentation links in the Hotkeys -> Edit -> Help docs.
(The hotkeys tutorial docs had somehow gone AWOL..)
o Fixed a problem with ^C not copying text from help viewers. (FLTK bug)
PYTHON LIBS
o Most python scripts + libs modified to simultaneously support python 2 and 3
INTERNALS
o String class thread safety: removed statics from Append(), Sprintf(), SprintfCat().
o Task: now has FIFO_ORDER
103.06rc1 (Fixes/Features) 02/19/15
_______________________________________________________________________________
RUSH
o OSX 10.10 Yosemite support.
Mods were needed to the bootscripts and daemon since "StartupItems"
has been abandoned by Apple in favor of "LaunchDaemons". Also, all GUI
programs needed mods to prevent a bug in Yosemite's handling of environment
variables provided to GUIs from the Finder. (Duplicate environment variables)
o Added -json flag to 'rush -lj' and 'rush -ljf'
Examples:
$ rush -lj -json
{
"Jobs": [
{
"Jobid": "yosemite.1",
"State": "Done",
"ActState": "Done",
"RebootId": "2052",
"Title": "MAYA-foo",
"DefPriority": "1",
"LogDir": "//eagle/net/tmp/scenes/foo.ma.log",
"LogExt": "-",
((..long report snipped..))
}
]
}
$ rush -lj -json -fmt "Jobid Frames Owner" -- only show Jobid/Frames/Owner from report
{
"Jobs": [
{
"Jobid": "yosemite.1",
"Frames": "5000",
"Owner": "render"
}
]
}
o rush: Fixed range check with 'rush -reorder'
If the same frame is specified more than once, it could crash the
daemon. Example: with a simple 10 frame job (1-10), the crash could
be induced with:
rush -reorder 1-10,5 1-10 tahoe.123 -fu
In older verisons (103.06rc1 and older), be careful with 'rush -reorder'
to make sure you don't specify frames more than once. For the above, the
'correct' version of the command would be:
rush -reorder 1 6 2-5 7-10 tahoe.123 -fu
o rush: Fix negative floating point frames issue (reported by mlester@spypost.com)
e.g. "-100.3" would show up as "-98.3", the integerized fraction was being
combined without taking into account the sign of the integer part.
Problem was in FrameType::Parse(). - MICHAEL/SPYPOST (103.06rc1)
o Added '*' to cpu specifications (e.g. "tahoe=*")
This is a way to request all cpus a machine is configured to use, instead of
having to specify the value in advance. Example: if 'tahoe' has 8 cpus
configured in rush/etc/hosts, then "tahoe=*@100" expands to "tahoe=8@100".
This has no meaning for +hostgroups, which do this automatically for each host,
and the number after the '=' represents a cap for the whole group.
o rushd: added -fg flag
Necessary for OSX 10.10 (Yosemite) which abandoned /Library/StartupItems
in favor of /Library/LaunchDaemons/ style boot, which insists on daemon
running in foreground.
o rush -checkhosts: improved to show multiple errors (instead of stopping
on first one), e.g.
$ rush -checkhosts
rush: 'rush -checkhosts': /usr/local/rush/etc/hosts: Line 43: host ea[192.168.1.22] already in hosts file as eagle[192.168.1.22]
rush: 'rush -checkhosts': /usr/local/rush/etc/hosts: Line 44: 'eagle[192.168.1.22]' and 'eagle[192.168.1.22]' have same host alias 'eagle'
rush: 'rush -checkhosts': /usr/local/rush/etc/hosts: Line 44: host eagle[192.168.1.22] already in hosts file as eagle[192.168.1.22]
rush: 'rush -checkhosts': /usr/local/rush/etc/hosts: Line 45: gethostbyname(foobar): unknown host -- may be negative cached
rush: 'rush -checkhosts': Two hosts 'eagle' and 'ea' have the same IP: 192.168.1.220
$ echo $status
1
o rush -checkhosts: now checks for:
o Duplicate hostnames, e.g. two different hostnames that are aliases for the same host and IP)
o Duplicate hostname aliases
o Duplicate IPs
o Failed hostname lookups
o rush/var/cpu.acct report now includes two new fields in the 'p' entries:
pre-103.06: p start-time() jobid title owner frame hostname pri elapsed systime usrtime exit/sig pid
103.06: p start-time() jobid title owner frame hostname pri elapsed systime usrtime exit/sig pid ram/tot_ram cpuslots
Specifically:
p start-time jobid title .. pid ram/tot_ram cpuslots
----------- --------
| |
| # cpus configured in rush/etc/hosts
| for current rendernode at the time
| this job ran.
|
Amount of ram job requested / total ram configured
in the rush/etc/hosts for this machine.
Old parsers unaware of these two new fields should be unaffected,
as they should simply ignore the added fields. New parsers can make
use of the new info when doing ram and cpu usage calculations.
o 'rush -showconf': added 'permit_fifo_order' to report, so that the
configured value of the new permit 'fifo-order' option can be viewed.
o 'rush -ljf': added new 'Fix' field to show 'Frame IndeX' values.
(Mostly for internal use)
o New rush.conf options:
permit
------
Added new 'fifo-order' option, so that fifo reordering with the
new 'rush -fifo-order' flag can be limited to certain users, e.g
permit
{
..
online,offline,getoff,kill,almighty,fifo-order:
{
..
}
}
cpuacct_ramcpus
---------------
Controls the two new fields added to 'p' lines of the cpu.acct file.
The default is 'on'; can be turned off to disable the new fields. Example:
pre-103.06: "p (start-time) (jobid) (title) (owner) (frame) (hostname) (pri) (elapsed-secs) (systime-secs) (usrtime-secs) (exit)/(sig) (pid)"
new: "p (start-time) (jobid) (title) (owner) (frame) (hostname) (pri) (elapsed-secs) (systime-secs) (usrtime-secs) (exit)/(sig) (pid) (ram)/(total-ram) (cpu-slots)"
..where the new fields are:
(ram) -- The amount of ram the job requested to use at submit time,
or has set with the 'rush -ram <jobid>' command.
(total-ram) -- The total ram configured in the rush/etc/hosts file
at the time the frame was rendering. Useful to determine
if the RAM value in the rush/etc/hosts file was changed.
(cpu-slots) -- The CPUS value in the rush/etc/hosts file
at the time the frame was rendering. Useful to determine
if the CPUS value in the rush/etc/hosts file was changed.
..these new values help scripts tally cpu utilization more accurately
when changes are made to the rush/etc/hosts file over time.
The default is enabled, since old parsers unaware of these two new fields
should be unaffected: they should simply ignore any extra fields on the line
it doesn't know how to parse. New parsers can make use of the new info when
doing ram and cpu usage calculations.
notes_use_udp
-------------
Controls if 'rush -notes' uses new low latency UDP or older TCP messaging.
Default is 'on' to use new low latency 'rush -notes' reporting.
Can be turned off to revert to use the older TCP protocol.
ip_reportbad
------------
This option controls how bad hostnames are reported in the
daemon logs. This feature is enabled by default so that bad
hostname lookups are reported in the daemon log. Can be disabled
if such errors get too chatty.
fmt_keys_103_06
---------------
This option cleans up how the 'rush -ljf' report handles
the special expansion of these two fields:
JobData[string]
Notes[string]
This flag is on by default to make the output more predictable,
but can be disabled if the 'predictable output' breaks old
behavior.
fifo_reset_flags
----------------
Controls what happens to the FIFO priority when a job finishes.
The current two supported values:
RUSH_FIFO_RESET_JOBDONE
-----------------------
This is the default, resets the FIFO priority when the job
is done so that if frames are requeued, the job will re-enter
the queue as if it had just been submitted. (So that the job
won't immediately take over the network due its seniority)
This is usually preferred to prevent users from keeping
old jobs around just to requeue frames so as to have FIFO
priority over jobs more recently submitted.
RUSH_FIFO_RESET_NEVER
---------------------
This causes the job to never reset its FIFO priority; the FIFO
priority sticks with the job even after it is done, such that
requeued frames will run with the same FIFO seniority the job
had when it was first submitted.
This perhaps unfairly allows users to keep requeing old
jobs and retain their old FIFO schedule ordering, which
will always usurp all younger jobs. The longer such jobs
stay in the queue, the more FIFO priority they'll have
when frames are requeued.
o rush: Added -key to -jobdata and -jobnotes
Allows changing values by keyname.
% rush -jobdata -key TD_NOTES 'Director approved.' tahoe.123
tahoe.123: jobdata for 'TD_NOTES' is now 'Director approved.'
o rush: fixed issue with 'rush -ljf -fmt' for resolving e.g. 'JobData[string]'.
Didn't work at all in 103.05, now works correctly:
$ rush -ljf zoar.99 -fmt 'JobData' <-- show the raw data
JobData[0]: SHOW:big_job <-- no space after : in data
JobData[1]: SHOT:sc37a <-- no space after : in data
JobData[2]: TAKE 200a <-- no : just space
JobData[3]: CAMA <-- no delimiter for 'CAM'
JobData[4]: LOO <-- empty string 'LOO'
JobData[5]: SCENE: scn48 <-- has : and trailing space
The proper use is e.g. "SHOW:big_job" and "SCENE: svn48" which shows the
proper use of job data where key and value pairs are separated by a colon
so that indexing with e.g. "JobData[SHOW]" and "JobData[SCENE]" will work correctly.
Pathological cases are also shown ("TAKE 200a" and "CAMA") and the behavior for those:
$ rush -lj zoar.99 -fmt 'JobData[SHOW:]:-14 JobData[SHOT:]:-14 JobData[SHOW]:-14 JobData[SHOT]:-14 JobData[SCENE]:-14 JobData[TAKE]:-14 JobData[CAM]:-14 JobData[LOO]:-14'
JobData[SHOW:] JobData[SHOT:] JobData[SHOW] JobData[SHOT] JobData[SCENE] JobData[TAKE] JobData[CAM] JobData[LOO]
big_job sc37a big_job sc37a scn48 200a A -
$ rush -ljf zoar.99 -fmt 'JobData[SHOW:] JobData[SHOT:] JobData[SHOW] JobData[SHOT] JobData[SCENE] JobData[TAKE] JobData[CAM] JobData[LOO]'
JobData[SHOW]: big_job <-- handles ending : in index
JobData[SHOT]: sc37a <-- handles ending : in index
JobData[SHOW]: big_job <-- handles no : in index
JobData[SHOT]: sc37a <-- handles no : in index
JobData[SCENE]: scn48 <-- handles not showing leading white after :
JobData[TAKE]: 200a <-- handles no : in data, no leading whitespace
JobData[CAM]: A <-- handles partial indexing normally
JobData[LOO]: <-- handles empty string
Made 'Notes' behave consistently as well:
$ rush -ljf zoar.99 -fmt Notes
Notes[0]: SHOW:big_job
Notes[1]: SHOT:sc37a
Notes[2]: TAKE 200a
Notes[3]: CAMA
Notes[4]: LOO
Notes[5]: SCENE: scn48
$ rush -lj zoar.99 -fmt 'Notes[SHOW:]:-14 Notes[SHOT:]:-14 Notes[SHOW]:-14 Notes[SHOT]:-14 Notes[SCENE]:-14 Notes[TAKE]:-14 Notes[CAM]:-14 Notes[LOO]:-14'
Notes[SHOW:] Notes[SHOT:] Notes[SHOW] Notes[SHOT] Notes[SCENE] Notes[TAKE] Notes[CAM] Notes[LOO]
big_job sc37a big_job sc37a scn48 200a A -
$ rush -ljf zoar.99 -fmt 'Notes[SHOW:] Notes[SHOT:] Notes[SHOW] Notes[SHOT] Notes[SCENE] Notes[TAKE] Notes[CAM] Notes[LOO]'
Notes[SHOW]: big_job
Notes[SHOT]: sc37a
Notes[SHOW]: big_job
Notes[SHOT]: sc37a
Notes[SCENE]: scn48
Notes[TAKE]: 200a
Notes[CAM]: A
Notes[LOO]:
IRUSH
o Jobs report now has a single operation to requeue failed frames
of multiple selected jobs in a single operation:
1) Select jobs from the Jobs report with Fail frames
2) Right-click and choose: Requeue Selected Jobs.. -> Fail
In older versions of Irush you had to do these steps for the same effect:
1) Select jobs from the Jobs report with Fail frames
2) Hit "Set Jobid" (this sets the RUSH_JOBID environment variable)
3) Run the following in the "Cmd" field: rush -que fail
..which uses the RUSH_JOBID environment variable
This new "Requeue Selected Jobs.." menu option also includes ways
to reuqueue "Done", "Hold", "Run" and "All Frames".
o The "Search filter" field's values are now saved across invocations of irush
in ~/.irush-search file. The file is loaded when irush starts, and updated
whenever the user types a new value into the Search field.
o When "Jobid:" field is hand-modified, report highlighting updates correctly - FLOQFX x/x/14
o Minimum size of lower tty now 100px fixed (instead of 25% of window) - FLOQFX 11/25/14
o "Priority +/-" button now restores 'All Jobs' report correctly. - FLOQFX 11/25/14
(Previously a standard 'rush -laj' report was shown, absent the new
extended fields, e.g. "Priority", "Progress", "Render Time", etc)
o Changed progress bar color 'Orn' (Hold) to contrast more from 'Red' (Fail) - FLOQFX 11/0x/14
o Fixed OSX stray tooltips popping up sometimes when guis iconified/stowed. - FLOQFX 11/2x/14
o Changed column cropping algorithm to avoid clipping issues with some fonts - FLOQFX 11/24/14
o irush/Mac: Ctrl-Click can now be used to bring up context menus so that
old apple computers missing Right Click mice can still access the context
menus via the Ctrl key. An option was added to Edit -> Preferences -> Ctrl-Click Menus
FLOQFX 11/xx/14
o Fixed problem with report clearing before selected jobs/frames recorded
into the IRUSH_FRAMES and IRUSH_JOBS variables before hotkey would run.
- SWISS 09/29/14
o Windows: fixed problem specifically on Windows where irush hotkeys
were setting the environment variable IRUSHFRAMES instead of IRUSH_FRAMES.
- CODE AUDIT 12/11/14
o Linux: added taskbar icon
ONRUSH
o Linux: added taskbar icon that reflects online/offline state
DOCS
o Improved docs for "user" command (in rush-submit-cmds.html)
o Removed "New in 102.xx" comments in rush-submit-cmds and rush-conf,
replaced with "Historical Notes".
103.06-pre (Special release for Zoic tests) 12/10/14
_______________________________________________________________________________
RUSH
o rush: Fixed crash if "app-cachemode none" specified in rush/etc/hosts file
An endless loop is avoided when caching is disabled.
o 'rush -notes' changed to use UDP.
Allows one to (finally) use 'rush -notes' during rendering without latency concerns.
(this feature can be disabled via the rush.conf command: "notes_use_udp 0" )
o rush: added 'rush -fifo-order' option to let users redefine FIFO ordering.
Examples:
rush -fifo-reorder 06/13/14,21:20:30 [jobid..] # m/d/y,h:m:s (same format -ljf reports)
rush -fifo-reorder 1234567890 [jobid..] # unix time(2) value
o rush: Fixed issue with FIFO reset on job Done not getting to cpuserver's scheduler
Fix: "Unpass" now piggybacks new FIFO value to nodes when job restarted.
-- JESSE@ZOIC 06/13/14
o rush: Fixed issue with 'rush -uping'; the '-c #' and '-b #' options
would always print an index error, and abort. This problem has been around
for a long time. -- S.PARKER/SONY 06/05/14
o rush -checkhosts and -checkconf: simplified output format..
> Removed redundant ALERT messages
> '-checkhosts' only prints the total hosts loaded if there were no errors
Examples -- note the '***' lines were removed:
OLD: $ rush -checkhosts /tmp/foo
rush: ALERT /tmp/foo: Line 3: expected 'app-hostcache none|demand|full' ***
rush: 'rush -checkhosts': /tmp/foo: Line 3: expected 'app-hostcache none|demand|full'
0 hosts in /tmp/foo ***
NEW: $ rush -checkhosts /tmp/foo
rush: 'rush -checkhosts': /tmp/foo: Line 3: expected 'app-hostcache none|demand|full'
o rush -lj -fmt: jobdata[XXX] now removes the XXX prefix from the printed string
so if you have "jobdata Scene=foo' then 'rush -lj -fmt "JobData[Scene=]"'
will print 'foo' instead of 'Scene=foo'
o Added RUSH_INDEXHINTS variable to renders; helps 'rush -notes'
avoid linear lookups on the jobserver for jobs + frames in the common
use case where one is changing the same frame that is being rendered.
o Fixed 'rush -tail -f'.. wasn't detecting new file data properly on unix.
(Worked OK on Windows)
o rush/etc/rush.conf:
> Added 'fifo-order' to permit { } to allow control over *who can use* 'rush -fifo-order', e.g.
permit
{
..
fifo-order:
{
jack
jane
wrangler
}
..
}
> Added 'fifo.reset' to control when job auto-resets the FIFO order:
# FIFO RESET
# Events that cause the FIFO time stamp to be reset.
# never -- never reset
# jobdone -- reset when job is done (default)
#
fifo.reset jobdone
> Changed rush.laj_secs default from 2 -> 3
IRUSH
o irush: Hand-entered jobids into Jobid: field updates report highlighting
ANTOINE/FLOQFX - 04/22/14
o irush: Fixed problem with irush not recongizing IP address jobids.
If the rush/etc/hosts file had an IP address in place of a hostname,
jobids for that machine would be e.g. 192.168.1.4.123
Rush could handle it, but irush's double-click did not.
Jobid detection code was old; replaced with Jobid class's detector.
AEVAR/BEEANDBIRD 06/12/14
o irush: [MAC] fixed problem with last pixel of text sometimes being cut off
(Problem with the ANSI mods to Fl_Browser; wasn't rounding up fl_width()'s return value)
ANTOINE/FLOQFX - 04/22/14
SUBMIT SCRIPTS
o submit_maya.py
> Added "Create Image Directory" option so that user can control
this. (Had to remove blocking dialog, as that doesn't work in
HTML submissions where blocking isn't really available)
> Improved support of html job submissions; all errors printed in HTML,
even script errors
RUSHTOP
o rushtop: Ctrl-/+/0 now works for the /numeric keypad/ keys as well
as the number keys along the top of the keyboard.
RUSHADMIN
o Changed default to Tan color theme
o Fixed some font size issues in main window and Permit Users screens.
o Fixed unnecessary horizontal scrollbar in main window.
BOOTSCRIPTS
o rush/etc/S99rush modified to skip localhost DNS lookup if IP hardcoded
in rush/etc/hosts (e.g. somehost=192.168.1.3) This allows a network
w/out hostname lookups to operate normally, while still holding back
rush boot until net iface is "up" (by checking the hardcoded IP)
INTERNALS
o Flattened out copyright notices; erco 1995~2007 reflects beginning of Rush
development (when it was first named 'nrq') thru 1999 when sold as Rush, then
the seriss take over 2008-'present'
o rush: Fixed problem in Spawn.C with parsing "indexhints"
If indexhints was "", would not parse, causing problems with StartIntermediateProcess()
Noticed this on PPC (tower).
103.05 (Fixes/Features) 03/07/14
-------------------------------------------------------------------------------
RUSH
o Fixed bug for machines not in rush hosts file
The 103.04 daemons can crash if a machine not in the rush/etc/hosts file
(but has rush installed) tries to contact the active daemons. (Problem
with reverse hostname lookups). This is an important fix; anyone running
103.04 should upgrade to 103.05 (or higher) to prevent this problem.
o Improved docs for 'rush -lc' to describe the messages in the NOTES field
o 'rush -status -usage' added features:
> Added network I/O for all platforms.
See the new 'N' lines of data in the 'rush -status' docs.
> Macs now include swap data (it was all zeroes before)
IRUSH
o Added a status bar to show how many lines are selected
in the window. (CHI/DELUXE)
Useful in the Frames report to see how many frames are selected,
or in the 'Hosts' report to see how many hosts are in the hosts
file; Hit 'Hosts' then hit ^A (select all) to see the count.
> Optimized daemon's purge of invalid hosts from jobs and tasks.
Previously, purge would happen effectively every 60 secs.
Changed so that purge only happens when rush/etc/hosts file is
actually reloaded. Mods to HOST_ReloadIfNecessary(). (BETTY@DELUXE 10/23/09)
> Optimized scheduler so that many "Done" jobs don't slow scheduling
This causes JobPass state tasks to be removed from scheduling (moves to the separate
passtasks[] array). Can be disabled via optimizejobpass in rush.conf.
(BETTY@DELUXE 10/23/09)
> 'rush -tasklist': added '-desched' flag to view the new passtasks[]
> Fixed problem with these errors during jobdonecommand:
SECURITY RUSH: uid '0' outside configured range 100-65000
INFO jobdonecommand 'ls' failed for jobid=leo.2: RUSH: uid '0' outside configured range 100-65000
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
This would happen when the job owner submits a job to a job server that doesn't
have his user account, but forceuid/gid is used to force everything to run as a
particular user (forceuid/gid).
Problem was: Spawn::ForkIt() was doing a UID range check on the uid/gid of the
user before the ForceUID/GID was being applied. A job with no local account for
the job owner will fallback to unknown uid/gids (0/0). Switch the code around
so the forceuid/gid is applied first (if any), THEN the check is done.
> New JobRemarks: and RushRemarks: fields in rush -ljf report
> Removed setsid() causing rush -log to orphan on unix machines
when invoked by irush
> Added '-showpath' flag to 'rush -log'
"-showpath" shows the absolute pathname of the logfile for the
specified frame on stdout.
This can be parsed by scripts that want the get the frame log's
pathname without actually displaying the log file. (This is also
used by Irush to get the pathname of the log file for the new
"View Log In Text Editor" option)
> rush -log now shows nfs error messages without the ### header (less confusion)
> New 'priority.range' option can be specified in rush.conf
(For more details, see ADMINISTRATIVE FEATURES below)
> Added 'r' flag to cpu specification, to allow 'randomizing' hostname assignments
in the cpus report for better distribution. (Warner) ie:
+any=50r -- randomize order of hosts when expanding +any hostgroup
(For more details, see ADMINISTRATIVE FEATURES below)
> Added 'affinity=' option to rush/etc/hosts file
You can now set processor affinity in the rush/etc/hosts file by tacking
'affinity=xxx' at the end of the line. (See below) -- 09/30/09
(For more details, see ADMINISTRATIVE FEATURES below)
> Added build date and copyright year to rush, rushd and rushtop.
> RUSHTOP:
> New display mode for showing multiproc machines as a single cpu bar.
The following shows an 8 processor machine showing up in normal multi-cpu-bar mode
vs the new single cpu bar mode:
o Frame range optimizations weren't enabled.
This speeds up changing the state of many frames at once, such
as doing a Frames -> Select All -> Que.
Code that optimized large lists of frames (eg. 7000 frames)
to convert 'rush -que 1 2 3 .. 7000' into a single 'rush -que 1-7000' command
was accidentally disabled due to a simple > vs >= bug. (TURNER)
o Added 'usetheme' to .irushrc file, to allow saving of user's Theme preference setting.
Also allows admin to define default theme in $RUSHDIR/rush/etc/.irushrc
o License warnings update automatically
o Added 'jobremarks' to "Job Edit" (TESTED, OK)
o Added 'irush -fu' command line flag, updated 'irush -help' (TESTED, OK)
o Fixed problem with auto-scrolling frames report when sorting enabled
(FATIMA @ HAMMERHEAD)
One line fix:
tty_browser->topline() == 1) // OLD
tty_browser->topline() <= 1) // NEW
o Fixed 'Edit -> Select All' option
(JEREMEY@BSGVFX 11/15/07)
o 'All Cpus' report: larger buttons under 'Hosts' section
> SUBMIT SCRIPTS:
o submit-3delight -- added new submit script
o submit-dependon and submit-dependon.bat demo:
removed unix-specific /bin/sleep commands.
o .common.pl prevents chdir() to tmpdir
o submit-fusion.pl -- Released with support for ConsoleSlave
o submit-animo.pl -- Added more "Alpha Channel" and Pixel Aspect Ratio options.
o submit-maya*.pl -- Added REPORTERROR=0 env variable setting to prevent senddmp.exe
(See rush.general posting from Greg on 01/29/2008)
o submit-maya-and-mray-tile -- removed old maya 'exit 128 license error' code
o submit-maya-tile -- added layers support
o submit-maya.pl -- added 'default' and 3delight Renderer: prompt options
> maya2008 mods (32bit and 64bit)
> 3delight plugin additions
> Removed old maya 'exit 128 license error' code
> added license pause ability, Licpause+Retry (DADO/WILDBRAIN)
> Warns about spaces in pathnames
o submit-harmony -- doc modifications
o submit-nuke -- numerous modifications for consistency
o submit-renderman -- numerous modifications for consistency
o submit-shake-quicktime -- numerous fixes to support codecs
o submit-softimage -- added -continue flag
o Added -presets and -help command line flags to:
> submit-3dsmax.pl
> submit-afterfx.pl
> submit-cinema4d.pl
> submit-combustion.pl
> submit-generic.pl
> submit-houdini.pl
> submit-mray-tile.pl
> submit-nuke.pl
> submit-rayz.pl
> submit-realflow.pl
> submit-renderman.pl
> submit-shake-quicktime.pl
> submit-turtle.pl
> RUSHADMIN:
> Added 'Scheduling' tab to adjust new rush.conf fifo scheduling flag
> Some minor onscreen documentation mods, small GUI improvements
> INPUT:
o added 'updatecommand' to 'choice'
> INTERNAL:
o String Library: fixed problem with String::ExpandEnvironmentVariable()
when expanding variables at the end of string. (Found when irush Hotkey
was set to e.g. "echo LOGNAME IS $LOGNAME", the $LOGNAME would be empty,
but using "echo LOGNAME IS ${LOGNAME}" would work.
o Updated TCP/UDP iface bind() error messages to include port number
o [INTERNAL] Back ported MicrosoftDeprecate.H
o [INTERNAL] Back ported MyMalloc.C exit callback
o Makefile: linux lib64 specifics
o Makefile: Mac now builds universal binaries by default
o FrameType: operator- and operator+ converted to const
o IRUSH: Converted frame optimization from doubles to FrameType,
to support large floating point frame numbers (10000.005),
avoiding suffering limitations of floating point precision.
Release Notes for 102.42a8 Features/Fixes: 02/15/2007
---------------------------------------------------------------------------------
> RUSHD
o OSX: Important fix for rushd.log filling Mac OSX disks with numerous errors:
[..]
12/14,00:00:00 FAIL/TCP Accept failed: Accept(): Socket operation on non-socket
12/14,00:00:00 FAIL/TCP Accept failed: Accept(): Socket operation on non-socket
12/14,00:00:00 FAIL/TCP Accept failed: Accept(): Socket operation on non-socket
[..]
This was caused by a bug in OSX 10.4.8 (and older) where the res_init(3) call
sometimes closes stdin (intermittant problem). This would happen whenever
the rush/etc/hosts file was pushed out, or with a 'rush -reload hosts'.
This is a bad, bad bug in OSX, so a workaround was implemented:
checks if stdin closed after res_init(), and if so, re-attaches stdin to /dev/null.
(Lubo/CHRISTOVFX, Michael/LOOKFX)
o UNIX: Close all unwanted file descriptors before invoking renders.
(eg. close 3..OPEN_MAX within 'intermediate process' after vfork)
o UNIX: Fix to 'rush -catlog' and 'rush -dcatlog' to prevent leaking
open file descriptors to daemon. (UNIX only; doing open() before fork())
o Fixed problem with 'donemail' not being sent if a jobdonecommand is also set.
o Small change to rush.conf file: removed 15 character truncation for hostname field
of the frames report:
BEFORE: framefmt "%-4s %-7s %-3d %-15.15s %-7d %-16s %-14s %-8s %s"
AFTER: framefmt "%-4s %-7s %-3d %-15s %-7d %-16s %-14s %-8s %s"
^^^^^
o CpuInfo-MICROSOFT: Fixed problem with cpu info not showing up under Microsoft Vista.
Involved zeroing out structures with memset() before making PDH calls.
o During submit, if 'logdir' is not accessable, error message includes the username
and hostname to give a permission context to the error message, eg:
OLD: rush -submit: LogDir: /some/path: permission denied
NEW: rush -submit: fred@tahoe: LogDir: /some/path: permission denied
^^^^^^^^^^
Esp. useful under windows, where the rushd service that has to access the file
is running under a different security context (which won't have access to the file)
vs. the submitting user.
o donemail: now prints reports in this order:
--- Frame Info Report:
--- Frames Report:
--- Job Report:
o rushd.log choke installed as added precaution for the above Accept() error msgs;
msgs won't repeat more than once every 5 seconds.
o Commented out title truncations from all submit scripts, so that job titles
derive from the complete scene filename.
o Stream library falls back to stderr if fp un-initialized.
o Added 'ssb=' field to 'rush -ping' to print 'Seconds Since Boot' value
for tracing problems with windows time stamps.
o WINDOWS: Fix for the 'rush -status' error:
X PdhValidatePath('\Memory\Pages Input/sec'): The specified object is not found on the system
..which was preventing some windows machines from not showing up in rushtop
because Windows wasn't providing Page In/Page Out counters. (seth/PROLOGUE FILMS)
> IRUSH
o New 'Search Filter' feature
See demo: http://seriss.com/rush/flash/irush-report-demo.html.
o Fixed 'Cmd' button causing sort buttons from previous report to disappear.
o WINDOWS: Now tries to use HOMEDRIVE and HOMEPATH environment
variables for saving the user's .irushrc file if HOME isn't set.
Falls back to c:\temp only if none of the above are set. (NIKLAS/SWISS INT'L)
o MySystem() checks to see if GetExitCode() fails
o Modifications for special priority sorting (RAINMAKER)
o (LINUX) Invoking help docs tries different attempts to open browser, in order:
htmlview, firefox, mozilla, konqueror.
o (LINUX) Install script now creates /etc/profile.d/rush-render-queue.{csh,sh} scripts,
to avoid modifying the /etc/profile and /etc/csh.cshrc* files.
> RUSHTOP
o WINDOWS: Now tries to use HOMEDRIVE and HOMEPATH environment
variables for saving the user's .rushtoprc file if HOME isn't set.
Falls back to c:\temp only if none of the above are set.
o Help viewer now have selectable text for copy/paste
> RUSHADMIN
o (WINDOWS) Fixed 'integrity check' problem with "Rush Config" tab
(CHI/RAINMAKER)
> SUBMIT SCRIPTS
o All submit script's menu bars now have a new 'Edit -> Preferences -> Use native filechooser'
option, which enables your local operating system's native file chooser.
(ie. on macs you'll get the 'mac' file chooser, on Windows you'll get
the default windows file chooser, etc)
Once you change this setting, it will be remembered for all your
rush submit script invocations.
Screenshots: http://seriss.com/rush-current/features/rush-102.42.html#NativeFileChooser
o All submit script's 'Help' viewers now have selectable text for copy/paste
You can now highlight text from the help screens, and use ^C to copy
examples into the paste buffer.
o submit-maya
> Added 'MI generation' option to just generate MI files
See the 'Render' pulldown menu for the new 'migen(mi)' option.
Click on the 'Help' button (at the bottom of the submit form) for more info
on how to use this new option.
o submit-maya + submit-maya-tile:
> Added optional "Project:" prompt, so that a fixed
project directory can be specified, instead of parsing the
project from the scene file pathname. (FILM ROMAN,NICKELODEON)
> Added new '-field' command line argument, so that /any/
of the input fields can be preset from the command line. Useful
for MEL script invocations.
> Added checks to see if scene file exists.
Both on submit, and during rendering. Prevents situations where Maya
doesn't return a non-zero exit code if scene file can't be opened. (alpha3)
> Added Maya 8.5 environment variable settings
o submit-maya-tile:
> Added 'Background Color:' field for setting background style.
This allows the user to either choose 'none' to allow the alpha channel to
be transparent, or to choose a specific color (such as 'white' or 'black')
to set the background to a flat color.
> Added Maya 8.5 environment variable settings
o submit-softimage:
> 'logtrim' default enabled to speed up rendering for "-verbose full"
Can be configured off easily by setting "$G::logtrim_always = 0;"
(STEVE/SUSPECTTV)
> Under windows, invokes "xsibatch.bat" instead of just "xsibatch"
(HARVEY/BSKYB, LOOKFX)
> 
Release Notes for 102.412 - FIX FOR WDPTV 06/24/04
--------------------------------------------------------------------------
> [RUSH.CONF] Added rush.conf option to adjust maximum jobid number 999.
WDPTV ran out of jobids on one machine on 06/24/04, wanted value to be
configurable.
Release Notes for 102.41 - RELEASE: 03/03/2004
--------------------------------------------------------------------------
> rush: JOB CHECK POINTING!!
Restarting a job server will bring the jobs back to life
from where they left off.
> Various submit script improvements
o Added 'submit-renderman', to submit Pixar's RIB renders
o Added 'submit-renderdotc' to submit Dot Software's 'RenderDotC' renders
o Added 'submit-nuke' to submit Digital Domain's 'Nuke' compositor.
o All submit scripts now have these under the Advanced Options:
> JobStartCommand - command to run before job starts rendering 1st frame
> JobDoneCommand - command to run when job finishes rendering last frame
> JobDumpCommand - command to run when job is dumped
> DoneMail - mail sent when job finishes rendering last frame
> DumpMail - mail sent when job is dumped
> AutoDump - Enables job to automatically dump
o All submit scripts now prevent 'batching' beyond the last frame
in frame range. New "Batch Clip" option control this feature.
o All submit scripts now have a 'Defaults' button;
Hit this to revert all input fields to their default values.
o (Windows) Fixed problem leaving frozen window behind after submit
o submit-lightwave: fixed bug preventing ConfigDir and ContentDir
from being passed properly to the lwsn command line.
o submit-lightwave: fixed bug ignoring frame batching value.
o submit-shake: fixed bug with file browser for shk files
Browser was searching for files ending in .ma and .mb instead of .shk.
o submit-maya.pl/windows: fixed problem leaving frozen window behind after submit
o submit-shake.pl: fixed problem with file browser for shk files
The browser was searching for files ending in .ma and .mb instead of .shk.
o submit-shake.pl: fixed 'update' button
This involved fixing the 'input' program; 'updatecommand' was not
in Field's class copy constructor.
o submit-maya: now runs FixPath() in $imagedir
This ensures the $imagedir respects any local changes made by the
sysadmin for the FixPath() function.
o Fixed bug with submit scripts sometimes showing empty error windows, eg:
----------------------------------------------
Render Flags: | -im CityWalls_Base_Node_$ENV{RUSH_FRAME} |
----------------------------------------------
..when frame 244 is rendering, this will expand to -im CityWalls_Base_Node1_244
on the maya command line.
> 'daemon-cachemode' and 'app-cachemode' have been moved from rush.conf to rush hosts.
This is to support the ability to have hostgroups in the rush.conf file
(which implies the hosts file has already been loaded..)
When upgrading, be sure to diff in this change to your existing rush
'hosts' and 'rush.conf' files.
> rushadmin/Mac: fixed copy/paste via Apple-C, Apple-V on the Mac
FLTK fixed a problem with the text editor where copy/paste via the keyboard
didn't work under Mac OSX. (GOLDCREST PRODS)
> irush: 'Job Edit' button now shows an error if jobid invalid
Before, it would simply open an empty 'Job Edit' screen.
> MAC: all guis can now be invoked from Finder
The OSX "Finder" appends a weird "-psnxxxxxx" flag to the application,
which was causing tools like 'rushtop' to only show the local machine.
Also, a /very/ empty PATH is passed to programs when invoked from Finder.
Rush GUIs now ensure a proper minimal path, and ignore this "-psn" flag.
> submit-shake.pl had a bug with batch frames
Was including batch value as step rate for shake, eg: 1-10x10 instead of 1-10.
> mac guis were not backgrounding when invoked from terminal
Modified wrapper to fork(). Was also affecting the submit scripts, which
would leave the submit window behind, because irush wasn't backgrounding. Fixed.
> IRIX: fixed problem with memory/swap reporting in 'rush -status'
Does not affect rushtop(1), but does affect the totals reported
in the M and S lines. (WDP/ADLER)
> logtrim(1) tool that comes with rush now has '-c cmd [args]' option
..so Windows can truncate output without loosing the exit code of the render.
DOS pipes don't pass the exit code of the renderer if its output
is piped through a filter (like logtrim), so -c is needed to do it
correctly.
> Tweaked PipeCommand and MyPipe to use CREATE_BREAKAWAY_FROM_JOB,
with limit JOB_OBJECT_LIMIT_BREAKAWAY_OK. Needed for submit-generic's
invocation of input.exe/MyPipe to be able to invoke irush/PipeCommand
without negative crosstalk between the parented jobs.
> Fixed adminuser permission check for commands like 'rush -dexit'.
> Fixed Udp::RemoteHostInfo() to show hostname in error msgs
> Upgraded to FLTK 1.1.2 to fix problem with 'I' cursor being left
behind after irush's 'job dump' confirmation dialog, which appeared
to be a bug in FLTK's Fl_Text_* widget(s).
> unix/onrush: show error dialog if 'rush -online/-offline/-getoff' fails.
Needed if invoking user is not in line_group.
> (WINDOWS) MyFile.C now does GetFileAttribute() check, so commands
like 'rush -log' (and in irush, log viewing) now advertise
real permission errors, instead of those stupid 'invalid argument'
errors from fopen().
> submit-generic.pl: documented exit codes in "?" help button for 'Commands:' prompt
> rush/linux: added links to install script to ensure "init 1" stops rush daemons
> Advanced to FLTK 1.1.3 in this release. Patches were made for Fl_Text_Editor
problems; see the FLTK newsgroup for messages dated on or around 03/23/03.
(escrow: See fltk.microsoft/ERCO text file describing these patches)
Release Notes for 102.40e - Fixes
--------------------------------------------------------------------------
> irush: online/offline confirm window now word-wraps
If the user selected many hosts to online/offline/getoff, confirm
window showed the hosts on a loooong single line. Now wordwraps.
Also, duplicate hostnames are now ignored.
1) Fixed width fonts in all browsers (Netscape 4.x + 6.x, Explorer, Mozilla 1.0)
2) Buttons are aligned nicely in all browsers.
(Note: older Netscape 4.x won't look as nice; doesn't support style sheets well)
> rush now uses Windows 2000 'Job Objects' to manage killing frames.
This should greatly improve rush's ability to kill jobs that have large, stubborn child process
trees under Windows 2000. The Unix version has always been good at killing process trees;
only windows needed the fix. For years Windows has had unreliable process killing until
Job Objects were implemented in Win2k.
> irush now has 'View cpus..' buttons in the 'Job Edit -> Cpus Modification' screen
Lets users cut + paste from list of cpus for adding to job or neverhosts.
o Revamped 'online help'; Now uses scrollable html based popup help.
Implemented into irush. New online irush 'tutorial' and 'Tips And Tricks'
sections were added.. Example irush online help screen:
o Image Command is now invoked if you hold down ALT while double clicking
on a frame. This obsoletes the 'Use Image Command' checkbox, so its
no longer needed in the irush preferences.
o Subtle bug with 'Use Image Command' caused checkbox to sometimes
show 'off', but image command would still run. Same changes applied to
'Use Colors' and 'Help Messages'. Code simplified.
o 'Hosts' and 'All Hosts' report now shows '???.???.???.???' hosts
in red, to help make obvious a problem is a foot.
o Fixed problem with 'Logs' button not lighting up during double click
on frame log. (Need this now that 'Tail Logs' option is available)
o Tooltip help messages have been added to all irush buttons now and
input fields. This includes the 'frame' and 'job' report screens,
describing what double click actions are available.
o Mods to ensure long running processes aren't left behind. Identified
this when 'rush -log -tail' was added. Both UNIX and MICROSOFT code
modified for PipeCommand class to ensure *killing* subprocess and
children; under unix, setsid() added.
o irush wasn't printing errors if 'rush' executable couldn't be found.
Fixed: now prints error in the tty window.
o 'Run' menu renamed 'Hotkeys'
> 'rush -an' only adds neverhosts if not already in the neverhosts list
> 'rush -ping' now includes the number of entries in the tasklist (tasks)
> 'rush -log' was reporting 'file not found' errors to cout
instead of cerr; fixed.
> Windows install script uses new setenv command that appends to PATH
without fear of quoting problems in existing paths. install.bat modified
and simplified. Also, ability to remove rush environment variables
added to uninstall.bat.
> INTERNALS:
o MyFile::Open() added optional 'mode' argument to force open perms
on things like tmp files.
o irush: Massive name changing for EditRunCommand -> EditHotKeyCommand,
runcmd -> hotkeycmd, and other related variable name changes.
o input: Multiple windows now supported; added 'winshow/winhide' options
to the 'button' type, and added 'hide' option to 'window' type.
o ntkill: improved error messaging, fixed problem where -f wasn't being
parsed correctly. Might improve killing of subprocesses.
o killpid.exe renamed to killtree.exe, rush.conf modified accordingly
o windows: improved performance of gmake by including -r
Release Notes for 102.31k - 02/05/02 Simple Fixes
--------------------------------------------------------------------------
> rush: ignores blank lines that contain white space in rush hosts file
> Backed out submit-maya.pl fix to clamp rendering beyond batch limit,
due to problems caused if a user adds more frames in irush later.
Better to render 'bonus' frames than to cause confusion when adding
frames.
> Windows: setsockopts() precedes bind() to ensure SO_REUSEADDR
correctly implemented.
> Windows: Various changes to TCP library to further detect and prevent
non-blocking I/O EADDRINUSE errors on connect(). Subtle fixes
made to error code checking and pass backs. 3 tier BSD error
deferral identified; bind() error deferred through connect()
and on to select().
> Tweaked bmrt-test.pl to include invoking 'perl' interpreter on self
to avoid weird winnt 'error #193'.
> rush/windows: implemented error #193 to complain about unknown interpreter.
Release Notes for 102.31j - 01/29/02 Simple Fixes
--------------------------------------------------------------------------
> irush: 'Job Edit->Done' wouldn't always indicate 'You're not owner' dialog.
Removed 'return(-1)' from AlertMessage.C during readqueue() loop.
> rush/windows: stdin was not being inherited by render scripts
This important fix helps people running Softimage/XSI and 'gmake' under
windows. Fixes 'stdin: unable to duplicate file handle' errors, and others.
> irush/unix: fixed 'pipe read error' when double clicking frames to view logs
SIGCLD signals from imgcommand's system(3) was causing read()s to fail.
> Added 'disablepflags' to rush.conf
Lets sysadmins disable 'k' and/or 'a' priority flags.
> submit-maya.pl tweaked to prevent run beyond last frame when batching.
Had to back this out in 102.31k due to problems this causes in irush
if frames are added.
Release Notes for 102.31i - 01/14/02 Simple Fixes
--------------------------------------------------------------------------
> IRUSH: "All Cpus -& Reque" and "Logs" now use jobid from report
This was causing the CURRENT JOB to be affected, instead of the job
selected from the 'All Cpus' report. Removed unusable or non-intuitive
controls (eg. 'Remove Cpu', 'Change Priority'), made separate controls
for the All Cpus report.
> Windows Only: removed "Pid:" from frame logs; it was reporting the
daemon's pid instead of the frame. Removed from log until this can
be resolved. Lack of fork()/exec() behavior makes this pretty hard :/
Release Notes for 102.31h1 - 01/11/02 Special Fix
--------------------------------------------------------------------------
> Fixed frame fail problem with linux served jobs rendering on windows machines
Linux job server was not interpreting SIGHUP messages sent by
NT machines correctly, causing requed, getoff'ed, or otherwise
bumped frames to not requeue, but would show up as 'Fail'. (VINTON 01/11/02: 102.31h1)
Release Notes for 102.31hg - 09/26/02 Special Fix: ESCFX
--------------------------------------------------------------------------
> Fixed bug where '0' as frame increment causes crash
Release Notes for 102.31hf - 09/20/02 Special Fix: ESCFX
--------------------------------------------------------------------------
> More attention to Logical.C constructor
Logical's assignment operator leaked memory. (ESC/FX 09/23/02)
Release Notes for 102.31he - 09/20/02 Special Fix: ESCFX
--------------------------------------------------------------------------
> Fixed memory leak
Logical's assignment operator leaked memory. (ESC/FX 09/20/02)
Release Notes for 102.31h - 01/08/02 Simple Fixes
--------------------------------------------------------------------------
> Fixed problem where tasklists grow with old jobs
Rush now sweeps old jobs out of the tasklist, to prevent accumulation
that would slow down the cpu scheduler. Problem would show on machines
reserved or offline for long periods during high volume job submissions.
Added 'taskkeepalivesecs' to rush.conf, which sets the keepalive interval.
Systems programmer notes: TASKCHANGE_KEEPALIVE messages added to protocol
to initiate sweeps. Modified: Task.[CH], Conf.[CH] Sched.C
(PROTOCOL CHANGE/CENTROPOLIS)
> Further speed improvement/optimization in windows Tcp transactions.
Removed SetLastError(), and added more correct error message generation
to make getsockopt(SO_ERROR) report errors from connect()s. Also:
o Replaced Tcp::Fgets with faster reader from rush.C.
o ReadSelect() now done BEFORE the recv()
o rush's private TcpFgets() consolidated into Tcp.C
o Error handling for BinaryRead() et al.
> irush now honors the RUSH_FU variable to preset the FU button
(TURNER)
> 'rush -jobnotes' multiline notes no longer uses multiple connections
Streamlined into one single connection. (PROTOCOL CHANGE/ESC FX)
> irush: fixed FLTK bug with tooltips showing wrong tooltip
Imported fix to Fl_Tooltip.cxx from fltk-1.1.0b8 over to local copy
of fltk-1.1.0b5.
> irush: fixed stuck-down buttons when doing right-click help while tooltip displayed
This was fixed in fltk by Mike Sweet in 1.1.0b9 and up. I imported
the fix to a local copy of 1.1.0b5.
> Fixed typo in examples/submit-lw.pl; "lwns" -> "lwsn". (CHERNICK)
> irush: About->Help: focus box disabled for monkey
> 'rush -submit' no longer blocks daemon if invoked interactively. (ESC FX)
Release Notes for 102.31g - 12/18/01 Simple Features/Fixes
--------------------------------------------------------------------------
> 'rush -cp' Can now change number cpus for host groups on the fly
You can now do things like 'rush -cp +any=100@200 =30' (ESC)
> keepall/keeplast implmented for Windows (they had never been ported)
> 'rush -reserve' does uid/gid range checks (CENTROPOLIS)
> Created Conf::CheckUidGidRange() to consolidate uid/gid range checks
Modified: Process.C, Spawn-UNIX.C, User.C
> Added 'submit-lw.pl' to the examples directory; submits lightwave jobs.
> 'framelist' and 'jobinfo' file perms abide 'forceuser' rules now
> Restored 'connection refused' for tcp connections.
Added select()/getsockopt(SO_ERROR) to handle non-blocking connect()s.
> Speed up of windows Tcp
Added black magic Sleep(0) to Windows Tcp::BinaryRead()
Release Notes for 102.31f (PRERELEASE) 11/09/01 Simple Features/Fixes
--------------------------------------------------------------------------
> Windows frame logs now log the actual user the process is running as (RunningAs:)
as well as the 'Nice:' and 'Pid:' values.
> Windows now keeps track of the user who submitted the job.
When users control each other's jobs, their usernames are now compared to determine
whether they are allowed to do so or not (eg. windows now heeds 'disablefu').
(PROTOCOL CHANGE)
Windows processes still run as the user configured for the service,
and when *windows jobs* run on *unix processors*, the user it runs as
is *still* the ntrushuid/gid.
> Removed 'OLD_SUBMIT' code in rushd.C; no need for it.
> OSX / Mac now supported.
No code was modified, only new -DARWIN files for CpuInfo and Net.
> RUSH modifications
o Added 'rush -lacf' (VINTON)
o permissions on framelist/jobinfo files were inherited from daemon.
now set umask to 0 so perms are open, just like the frame logs
o 'rush -lc' 'cpuspec' column widened by a few chars to prevent
ragged reports. At some point this should be customizable,
just like the -lj/-laj reports.
o Windows/rushd now uses a 'sharing write lock'
to prevent DOS xcopy from hanging when it hits the .RUSHD.LCK file
during customer installation.
o rush 'nevercpus' now supports +hostgroup specifications
'rush -an/-rn' has had +hostgroup support for a while.
o rush/windows: MicroSoft.C: full error messages now supported
Fixes from common/MicroSoft.C applied to daemon.
o .rushd.LCK file now contains the rushd's PID
o "Fgets(): recv(fd,buf,1): got 0 bytes" errors now indicate remote host info
(VINTON)
> IRUSH modifications
o Added to Edit->Preferences->Use Image Command
o rushtop remembers previous window size
o 'Cpus' and 'Frame Info' reports now in color
Added 'Frame Info' report type to Run->Edit menu, tested.
o Fixed sorting behavior for first column of all color reports
Color formatting characters were affecting alphabetic sorting of first column.
Few noticed; alphabetical ordering wasn't as critical as the grouping.
o irush: fixed sorting behavior for color "** NO RESPONSE" messages
(VINTON)
o Irush's window size is preserved in ~/.irushrc
o Fixed 'tabbing order' focus navigation for all buttons/controls
o Added 'Network -> Rushtop Window' and File->New->Rushtop + Onrush
Gives easy access to the other programs from within irush.
o irush: Added 'Edit->Preferences->Help Messages'
This allows disabling the 'tooltip' help messages
> onrush:
o added Fl::wait(0.1) for 'NO DATA', disabled chooser coloring
o status selector is now always white.
> rushsendmail (windows) moved from rush/bin to rush/etc/bin
> input: mods to support better submit GUI behavior for windows
o buttons now have 'exitok' keyword
o buttons now have 'xyinc' keyword
o buttons no longer unlink the INPUT_DBASE file (command must do it)
> Using new version of GUI toolkit FLTK 1.1.0b5
This fixes some redraw problems, event bugs, cut + paste behavior,
and adds 'focus box' behavior, etc.
> Source code preparation for deposit -- #define MICROSOFT, etc.
> All inconsistent references to 'neverhosts' in code and docs
now changed to 'nevercpus'
Release Notes for 102.31e - 11/06/01 Simple Features/Fixes
--------------------------------------------------------------------------
> irush: simplified interface layout
Did various things to help irush compile with fltk 1.1.0b5
(but still releasing with fltk 1.0.9). Among other things,
sort buttons use new MyButton::SetFocusBox(0) to disable
focus box. FLTK 1.1.0b5 MODIFICATIONS: 1) Symbols commented
out from fl_draw.cxx and unconditional return added to
fl_symbols.cxx, 2) Fl_Choice patch applied to prevent
"Select All.." down-button overdrawing text for choices.
> rush -dexit/-dexitnow kills renders before exiting
> rushd: improved PDH error message reporting
All errors in PDHMSG.H implemented.
> irush: Fixed sizing behavior of gray window after divider repositioned
If after reposition of divider, double clicking a frame to view logs
caused divider to revert to a previous position. FL_DRAG now sets savebar_y.
> irush: Fixed delay with double click on frame to see logs
Using Fl::wait(0.1) during pipe reading waits.
> Added diagnostics (-dlog a) for job dumping
to help trace delays in windows version during dumping.
> rush/var/lastjobid file included in release
Helps scripts that try to read this file
to predict the next jobid will work after
a new install or upgrade.
> A keyhit will now close help windows
Supports use of focus box and spacebar to open windows
> Added /MD compile flag to ensure multithreaded DLL
> irush: On exit, kills any pending operations
This prevents delays when choosing close, as it would wait
until other operations would complete.
Release Notes for 102.31d - 10/28/01 Simple Features/Fixes
--------------------------------------------------------------------------
> Windows rush now supports donemail
rush.conf must have 'smtpserver' and 'smtpfrom' configured
for donemail to work under windows.
> Admin can control column formatting of 'rush -lj / -laj' via rush.conf
Customers can now change the output format of -lj and -laj via
these new rush.conf commands: jobheader1, jobheader2, jobfmt,
alljobsheader1, alljobsheader2, alljobsfmt.
> rush(1): added "-t <tcp_timeout>" flag to control tcp timeouts
Rewrote TCP library to use non-blocking sockets. That was fun.
(CENTROPOLIS)
> Fixed rushtop bug where MANY windows would open if typo on command line.
If user specified incorrect hostnames on command line, caused rushtop to open
multiple error windows.
> Added 'tcptimeout' to the rush.conf file, to control the default
This setting affects the default for both daemon (rushd) and client (rush).
> irush: windows resize behavior modified when grey window open
When window is resized, if grey tty area is present, it sizes with
the screen. If it's not present, then the white tty resizes.
This also corrects a problem where a resize could cause the tty area
to run into the button area.
> rush on windows: squelch 'connection reset by peer' messages in -laj.
These messages are from machines up but not running rush. MS doesn't
give the return address, so it's a useless error.
> irush: jobids on command line overrides RUSH_JOBID variable
Also: when jobid set, title of window changes to jobid WITHOUT
the distracting irush version info.
> input(1) now supports creating simple popup boxes
-p and -t options added.
> rushtop: added -s command line argument to control update speed
(CENTROPOLIS)
> All GUI's now have icon names (Fl_Window::xclass("name"))
This allows icons to be assigned to windows (CENTROPOLIS)
> rushtop -help GP fault under windows fixed
Release Notes for 102.31c - 10/20/01 Important Bugfix/Features
--------------------------------------------------------------------------
> Fixed stray pointer bug that affects dependon in Windows
Modified String::SetFieldSep() (VINTON)
> rushd closes all unused sockets/files before spawning render
This prevented rushd restarts when orphaned renders were still running.
Unix and Windows. (CENTROPOLIS)
> irush/rushtop/onrush modified to not eat Xwindows colormap
Added Fl::visual() to main, prevents Fl_Pixmap() from razing
the colormap to the ill effect of other X programs (CENTROPOLIS)
> rushtop(1): corrected reporting of ram for linux
Wasn't subtracting out kernel buffers and caches from used memory,
causing rushtop(1) to show more ram in use than was necessary. (ICT)
> irush: added Fl_Window::xclass("irush") to support icons
> rush -push verifies remote Close()ed correctly
Release Notes for 102.31b - 10/16/01 Important Bugfix/Features
--------------------------------------------------------------------------
> Avoid bind() errors during daemon restarts.
Stop/Starting the daemon causes it to start immediately, avoiding 1 or 2 minute
Added new rush.conf option 'tcplistener.reuseaddr'
> Added daemon lock file, to prevent multiple instances of daemon
Prints error if starting extra daemon, eg:
# /etc/init.d/rush start
rush start: rushd: daemon already running
> Fix for logdir creation in NFS directories not exported to root
This fix should really work this time, unlike 102.30e. (GVFX)
> IsFile_NET() includes character devices as files now.
Important fix to bug introduced in 102.31 wrt /dev/null
changing from a character device to a normal file when logfile
is /dev/null (ie. logging is disabled), esp when using 'rush -reserve'!
Release Notes for 102.31a - 10/13/01 Features/Fixes
--------------------------------------------------------------------------
> rushtop(1) indicates dead machines by drawing white "////"s over cpu bar
> rushtop(1) now properly shows cpu activity for dual proc linux hosts
cpu0 always showed 0 activity, while cpu1 showed correctly. Fixed.
> Windows rushd closes CreateProcess() handles hThread and hProcess
during process kills. The rushd.exe "handles" count was increasing whenever
processes were Killed. Fixed.
> rush.conf defaults modified, as per Centropolis experiments:
maxnewtaskmsgs: changed from 20 to 30
jobupdatethrottle: changed from 30 to 10
> rushtop(1) now sorts all hosts alphabetically
> rushtop(1) on unix now backgrounds itself unless new -nofork flag specified.
> rushtop(1) new flags added: -d and -nofork
> Fixed these windows specific problems:
o Fixed rushtop(1) so as not to leave behind orphaned 'rush.exe' processes.
o rushd(1) now backgrounds process kills.
Improves speed on slow or loaded machines.
o Fixed release scripts: rush wasn't killing processes because the new
killpid.exe program was released to examples\bin instead of etc\bin.
o Fixed rushd(1) so both cpus of dual proc windows machines show up
in rushtop(1).
o Fixed problem where hitting 'Send' caused an error in the TTY window
about the "2>&1" redirection.
Release Notes for 102.31 - 10/01/01 MAJOR FEATURES RELEASE
--------------------------------------------------------------------------
> 102.31 RUSH ENHANCEMENTS:
o New 'rushtop' gui shows realtime graphs of cpu, memory and swap
for all machines running rush daemons. Similar to SGI's 'gr_osview(1)
but for all processors on the net, not just one machine.
rushtop(1) screenshots. Bars update once per second.
o New 'rushadmin' GUI simplifies remote admin of rush config files.
This program lets you modify rush config files, and quickly distribute
them out to all the other machines.
o Added 'os=unix' and 'os=windows' prefixes to rush.conf
This allows a single 'rush.conf' file to be maintained across platforms.
The 'os=..' command can be used as a prefix to any rush.conf command.
See docs for details.
o Added new job paused state 'LicPause',
and new submit command 'licpausesecs' to set number of seconds
before job unpauses. Useful for handling render license errors.
o New 'rush -push' simplifies distributing rush hosts/license/config files.
New administrative command simplifies distribution of common rush
files easy, esp. on multiple platform networks.
o Added Cpu/Memory/Swap fields to 'rush -status' reports
This supplies cpu/memory info to the new rushtop(1) gui, which shows
cpu and memory load on remote processors.
o Added 'allowpush' to rush.conf. Enables/disables new sysadmin feature
that allows license, hosts and config file to be easily distributed
to the network (similar to 'yppush').
o Added MaxCpus; 'rush -maxcpus', irush "Job Edit" updated
(But probably not yet recommended for use)
o Added -lhg (list host groups) and -lhc (list host criteria).
Also added these options to irush in "Networks -> Show All Criteria"
and "Networks -> Show All Hostgroups"
o 'rush -log' now complains if no frames specified; was silent.
o Some rush return values in 'rush -log' were -1 instead of 1
o Serv2Port_NET() modified to handle port numbers in the context
of service names. (if service name's first char is digit).
o Serv2Port_NET() returns _host_ order port number instead of net.
All code modified to support change.
o iface errors improved to show in netstat format "(ip.ip.ip.ip:port)"
o Udp overhauled to be more generic for bidirectional transmissions
o Udp GetRemotePort() made portable
o Updated email: erco@netcom.com -> erco@3dsite.com
o (internal) Consolidated all xpm's to one xpm dir
o Added "Title:" to rush's frame log headers.
o Udp 'connection refused' now reports remote hostname, if any
> 102.31 RUSH FIXES:
o malloc()s, strdup()s and 'new' never fail to allocate memory.
Errors are logged to the rushd.log. Prevents daemons from dumping when machine
is in near-death swapping during rendering.
o Fixed 'not in process table' error messages
o Conf file reload causes killcommand.Clear()
o Now announces uid/gid problems with remotes in 'rush -lc' reports.
'newtasknak' messages added. PROTOCOL INCOMPATIBLE WITH 102.30e and lower.
(GVFX/EMERSON)
o When logdir isn't accessible on a remote machine, the error
is now added to the cpus report, instead of just the rushd.log
> 102.31 IRUSH ENHANCEMENTS:
o Added 'Down' button to frames/cpus/hosts control bar
so users can interactively invoke 'rush -down' to indicate
rush remote hosts are down.
o Double clicking a frame shows log for that frame
(as well as ImgCommand, if any.)
o Job reports show 'LicPause' jobs in dark cyan
o Added 'LicPause' to 'Job Controls' window
o Added 'licpausesecs' to 'Job Edit' window
o Fixed tabbing order for 'Job Edit' input prompts
o ALT-L hotkey: invokes 'Logs' in frames report
o Jobid and version number now shown in title bar.
o "Logs" button rellocated slightly; some users complained
it was too close to the relatively destructive 'Que' button.
(STEAMBOAT)
o Added 'Log Flags' chooser to job editor
o Added 'Daemon Logs' button to 'Frames' 'All Hosts'
and 'Cpus' reports shows logs with color high lighting
o Holds last scrolled position in framelist for operations
such as view 'logs' and 'try'. Similarly, in large cpu reports
when doing operations such as changing priorities, removing cpus,
etc.
> 102.31 IRUSH FIXES:
o Fixed broken 'Cpus -> Nevercpus' errors that surfaced in 102.30e.
> 102.31 INPUT ENHANCEMENTS:
('input' is the GUI behind the submit-generic/submit-maya scripts)
o submit-generic.pl and submit-maya.pl now let you save/retrieve
your input fields to/from a file. Windows are also resizable now.
input(1): Added new 'menubar' command to window{} block, which
adds the 'File' menubar to the interface, letting users save/load
their data entries. (525/KWCC/DIGITALLAB)
o AlertMessage windows now resize to text specified (input, etc)
> 102.31 INPUT GUI FIXES:
o Input had bug with printing error messages (Insert(0,msg)
instead of Insert(msg,0)). Affected debugging of 'input'
based programs, caused them to coredump on an error.
o submit-generic.pl now appends an 'exit' to commands if the shell
is DOS-Batch, to ensure the exit code of the last command is returned.
(MEGIDDO)
> 102.31 MISC:
o Fixed help windows from getting stuck on screen if user moves mouse
out of window before it is created. (Under Windows, if you drag right
or down, still leaves window up. But that's an fltk problem)
o .render and .submit added to NT for csh users
o NT version default 'taskcleanuphour' was 19 instead of 5
o manpage for rushd added
o Tutorial improved; add Frame Logs, Pausing Jobs.
o NT install.bat does a pushd to the bin dir, so script can be run
with rsh as a single command.
Release Notes for 102.30h - 08-01-01
--------------------------------------------------------------------------
> During submit, ensure can't add same frame# to a job twice, eg:
frames 1-10 5
Job::Addframes() was modified.
Release Notes for 102.30g - 07-10-01
--------------------------------------------------------------------------
> FIX: (linux) mac address was ignored if dummy interface installed.
Affects only linux machines acting as license servers.
Release Notes for 102.30f - 06-02-01
--------------------------------------------------------------------------
> FIX: rush -status not honoring -s [secs] due to mods made
in 102.30e. This affected esp. onrush, causing onrush to eat
cpu because 'rush -status' was spooling out so much data.
Release Notes for 102.30e - 05-30-01
--------------------------------------------------------------------------
> FIX: rush -status not honoring -s [secs] due to mods made
in 102.30e. This affected esp. onrush, causing onrush to eat
cpu because 'rush -status' was spooling out so much data.
> FIX: submit fails if root can't access the log directory.
eg. '[pathname]: not a directory' even though it IS a directory,
just not accessible by root.(WDTV)
> FIX: daemons now detect changed license file automatically.
Prevents need to reboot daemons to see new license file.
Also fixed maxhosts counter -- was failing with n-1 hosts instead of n.
> FIX: GetIdent() in Lic-LINUX close() sock and fopen()'s.
> ENHANCE: rush -lac/-laj/-status now complete as soon as all hosts
requested have responded; ie. doesn't keep waiting '-s <secs>'
unless one or more hosts haven't responded yet.
> ENHANCE: 'rush -jobnotes' now reads from stdin if no notes are supplied
on the command line. This also helps irush edit jobnotes that contain
special characters or blank lines.
> FIX: rush(1) help; updated help (removed -lajq and other obsolete flags)
Release Notes for 102.30d - 05-20-01
--------------------------------------------------------------------------
> ENHANCE: IRUSH: Job reports show in colors (CENTROP)
> FIX: 'List All Jobs' (-laj) wasn't showing new Done/Fail states for jobs.
Release Notes for 102.30c - 05-07-01
--------------------------------------------------------------------------
> ENHANCE: Added new submit script option 'maxtime' which lets one
configure a maximum time for rendering frames, before the
frame is automatically requeued. See MaxTime docs. (CENTROP/525)
> ENHANCE: irush: added colors to frame reports (Fail shows red,
Run shows green, etc). Colors can be turned on and off
via "Edit->Preferences->Use Colors", which is saved
in your ~/.irushrc file. (CENTROP)
> ENHANCE: irush: added column sorts. Click on headings to sort by that heading. (3DSITE/WDTV)
> ENHANCE: Popup help documentation added to onrush.
> FIX: irush:
o Added new 'maxtime' value to Job Edit window
o Dump/End/Pause/Continue makes proper job controls appear,
regardless of previous context
o Fixed tabing traversal problem in Job Edit; with DoneCommand
and ImgCommand.
o Help windows pop up quicker
o Fixed problem with help windows constraining within irush
o Help appears on button *release*, preventing stuck open wins.
o irush now uses common HelpWindow class
o split bar position no longer lost when window resized.
Added call to Fl_Group::init_sizes() whenever split bar moved.
> FIX: irush/onrush/input: HelpWindow no longer has bug where sometimes
opens constrained within the irush window, instead of over it.
Prevented delete/create for each popup by adding resizable() to
HelpWindow(). Modified MyInput/onrush/irush.
> ENHANCE: 'input' (used by submit-maya.pl, etc) modified to:
o Allow colors to be specified for buttons
o Single buttons that can run simple commands directly
o A way to specify simple system() calls vs. piped output
o Can optionally specify 'showfail' on a per-widget basis
> RELEASE: documentation is now separate from the distribution
Release Notes for 102.30b - 05-02-01
--------------------------------------------------------------------------
> FIX: irush/windows only: PipeCommand fixed buffer overrun
during ReadFile() operations that was breaking \r handling.
> FIX: rush operations no longer modify the user's frame notes,
but may append message output to the frame notes field in reports.
(internally, new 'rushnotes' field added to Frame.[CH], which is
now maintained separately)
> ENHANCE: New submit script 'frameflags keepnotes' allows controlling
the behavior of whether frame notes are auto-cleared or not.
Release Notes for 102.30a - 04-28-01
--------------------------------------------------------------------------
(eval release to megiddo)
> FIX: irush: "** NO RESPONSE FROM" messages ignored during
cpu/job selections (ie. 'select all')
> FIX: irush: when multiple jobids are set and you hit 'Jobs',
all jobs for each UNIQUE machine are shown. This prevents redundant
reports for the same machines. (GVFX)
> FIX: irush should now handle \r's properly. Old behavior can still
be gotten via 'irush -nofix', an option that will become obsolete. (MEGGIDO)
(eval release below this point)
> FIX: stuck 'Strt' state frames fixes.
o Ignores stale DONE messages for previous frames. Added check to verify
not only sequence numbers, but frame numbers as well.
o Ignores re-reaping process if already in DONE state. Included checks
for multiple active processes with same PID.
> FIX: 'JOBPASS ignored/state already JOBPASS' messages are now handled.
> FIX: submit-generic.pl bug fixed where it was getting notes from all
jobs on the machine, instead of just the one in progress.
> FIX: optimization for 200 'single frame' jobs all submitted at once.
Manifest:
o Added 'maxnewtaskmsgs' to rush.conf files
o Optimized sending newtaskmessages to prevent storming.
New 'maxnewtaskmsgs' throttles back outbound messages to
controllable amounts.
> ENHANCE: Job reports show job state to be "Done" when all the frames are
Done, 'Fail' when one or more frames have failed and the rest are done.
> ENHANCE: Benign messages about sequence ids are squelched.
Can be enabled via 'rush -dlog q'
> INTERNALS: In Job.C, references to 'state' -> 'GetState()'
Release Notes for 102.30 - 04-23-01
--------------------------------------------------------------------------
> ENHANCE: Added 'nice' as an option to the submit script, and lowered
the default to 10. The old default seemed to have a profound effect
on render times under i386/RedHat 6.1.
> FIX: 'Imgcommand' in submit scripts was only getting the first word.
Release Notes for 102.21b - 04-17-01
--------------------------------------------------------------------------
> ENHANCE: Created 'onrush' gui to control online/offline state of rush daemon
> ENHANCE: All daemon state changes are now logged
> ENHANCE: Added submit-generic.pl to NT release
> FIX: Misc tweaks to submit-maya.pl and submit-generic.pl
> FIX: fixed problem w/WINNT only: bumped/getoffed frames were "Fail"ing
instead of requeueing.
> INTERNALS: rush/common directory created, irush/onrush/input programs
now all use common libs.
Release Notes for 102.21a - 04-10-01
--------------------------------------------------------------------------
> FIX: www-rush brought up to date with 'List All Hosts', Change Priority,
supports new '.' jobid separator, etc.
> ENHANCE: Boot script handles more graceful shutdown when renders are running.
Also, INIT.D messages added to rushd.log for clarity.
> ENHANCE: submit-maya.pl made more generic.
> ENHANCE: 'input' program now supports new 'showfail' flag, to control
whether failure popups are displayed, in addition to the error windows.
> ENHANCE: Added 'rush -cp' to allow changing of priorities on the fly
> ENHANCE: 'PRI' column added to 'rush -lc' reports, eg:
From: "STATE FRM PID JOBTID ELAPSED NOTES";
To: "STATE FRM PID JOBTID PRI ELAPSED NOTES";
^^^^^^^^^^^^^
> ENHANCE: irush supports changing priorities on the fly with new -cp option.
See 'Priority' button/input control in 'Cpus' report.
> ENHANCE: Added 'Uping' buttons to "Cpu Controls" and "Host Controls"
> ENHANCE: Added 'All Hosts Full' to main reports window
> FIX: Priority value sanity checks didn't prevent bad values from taking
place. Rewrote Priority::SetPriorityStr(const String& s).
> FIX: irush missing on-line help for "Cpu Controls" and "Host Controls"
> INTERNAL: Cpus_TCPCMD() [rushd.C] mods:
From: #define EMSG "FAIL/NEVERHOSTS"
To: #define EMSG "FAIL/CPUS"
^^^^
From: msg << "expected '" << cmdname << " <jobid> <fu> <specs..>', "
To: msg << "expected '" << cmd << " <jobid> <fu> <specs..>', "
^^^
> INTERNAL: All comments refering to 'ChangeRequest()' [*.C,*.H]
changed to 'Task::JobChanged()'
Release Notes for 102.21 - 04-02-01
--------------------------------------------------------------------------
> ENHANCE: added tcpsockopt to rush.conf file, including 'TCP_NODELAY'
which is now set by default
> FIX: WINNT not removing C:/TEMP/.RUSH_TMP directories correctly.
"RMDIR /Q /S" replaced with recursive FindFiles()/DeleteFile()/RemoveDirectory()
> FIX: Changed RUSH_ISDAEMON to include pid of daemon, so render scripts
invoking rush(1) don't print those 'reloading hosts file' messages.
> FIX: WINNT error messages #32 and #33 fixed to show descriptive messages
> ENHANCE: Windows NextPort() now called every tcp connect, rather than just
when a program starts. ('static unsigned int alport' -> 'unsigned int alport')
> submit-generic.pl included in unix releases
Release Notes for 102.20g - 03-30-01
--------------------------------------------------------------------------
> FIX: 'connection refused' problem fixed in rresvport() for all UNIX platforms.
The Windows fix (101.81) was now brought into compiles for all platforms.
Release Notes for 102.20e - 03-24-01
--------------------------------------------------------------------------
> ENHANCE: irush backgrounds the 'imgcommand' using CreateProcess() on NT,
and a fork()/system() on unix.
> FIX: WINNT: socket()'s are all set to be non-inheritable,
so child processes don't inherit TCP/UDP sockets, which can cause
daemon restart difficulties if child renders with bound sockets
become orphaned. (525)
> FIX: Rewrote daemon redirection code; includes O_NOINHERIT for NT
so daemon's log not inherited by child processes. Should also prevent
all problems with NT daemon's log becoming silent. (525)
Release Notes for 102.20d - 03-20-01
--------------------------------------------------------------------------
> ENHANCE: NT only: Special >CONSOLE_BREAK_EVENT< added to rush.conf's
'killcommand', so one can enable the internal kill mechanism if desired.
Used to be this was ALWAYS used, preceding any configured killcommands.
But this prooved to be troublesome, since in some cases it orphaned
renders before the better perl kill scripts could do it a better way. (525)
> ENHANCE: Submit process optimized, to prevent unnecessary
destructor/constructor activity; submits of jobs with large
frame lists should be snappier.
> ENHANCE: Added 'jobidsep' to rush.conf file.
Allows sysadmin to change jobid separator character if needed.
Only '.' and '-' are recommended. Some companies may find '.'
avoids problems on networks with hostnames like 'nt-3' (525)
> FIX: UDPBUFSIZE set to 65000 for rush -laj/-lac/-status..
these Udp oriented reports had a 1000 character limit. (GVFX)
> FIX: IRUSH 'Job Edit' wasn't handling multiple jobids for WaitFor
and DependOn, and wasn't checking for trailing commas needed by
the command line.
> DEBUG: MyMalloc setup to use LinkList over array for increased
speed during debug testing
Release Notes for 102.20c - 03-16-01
--------------------------------------------------------------------------
> ENHANCE: If an 'imgcommand' is configured for a job, irush will invoke
the command when you double click on a frame in the frame list.
> ENHANCE: irush 'try' count reset added to 'Frame Controls'
> ENHANCE: irush 'JOB EDIT' now has prompt for LogDir
> ENHANCE: irush REPEAT button now highlights all repeatable buttons
> ENHANCE: irush JOB EDIT, DUMP and END buttons repositioned, to avoid
accidental DUMPs.
> ENHANCE: windows install script makes sure C:\TEMP exists (525)
> ENHANCE: 'rush -que run|start|die' added
> ENHANCE: Added 'ImgCommand' to submit script, 'rush -imgcommand' for irush.
> FIX: (525 Studios) fixed problem where jobs get cpus stuck in 'Done' state
in cpu reports.. Job server wasn't reverting on duplicate messages.
> FIX: A job is now done when dumped/ended if all its cpus
(rush -lc) are not busy. This, as opposed to checking the
framelist. (Works around stuck 'Strt' frames so job can still be dumped)
> FIX: Reboot logging, and setuid() logging was missing CRLF's.
> INTERNAL: 'X' debugging now simulates duplicate udp packets as well
Release Notes for 102.20b - 03-03-01
--------------------------------------------------------------------------
> EXAMPLES: Included works in progress for R&D purposes only:
${RUSH_DIR}/examples/bin/input
${RUSH_DIR}/examples/renderman.in
${RUSH_DIR}/examples/bmrt-test.pl
> ENHANCE: gethostname() errors fixed, use NETERR instead of SYSERR, etc.
> ENHANCE: new rush.conf command 'killcommand', used ** by NT only **,
allows one to set their own command used to kill process ids. Useful
for killing stubborn CSH that comes with houdini, eg:
killcommand csh -c "kill -HUP %ld"
> FIX: Check for host dot-notation now uses %d.%d check instead of
isdigit(hostname[0]) to avoid numeric hostname situations
such as 3dsite.com.
> FIX: Local host lookups now use ipaddr by default to avoid customer
hostname(1) output not matching contents of rush hosts list.
Use 'oldlocalhost' rush.conf flag to disable this feature.
Release Notes for 102.20a - 03-01-01
--------------------------------------------------------------------------
> FIX: Workaround for irix fork()/setpgid() SGI panic on multiproc
origin w/6.5.8 Use 'irixsetpgid' rush.conf flag to disable this workaround.
Release Notes for 102.20 - 02-17-01
--------------------------------------------------------------------------
> ENHANCE:
The behavior for 'rush -lac' has been moved to 'rush -lah',
since it 'Lists All Hosts'.
'rush -lac' now lists the status of all cpus on the network,
which is more reasonable behavior.
> ENHANCE: 102.17c's new options -lajq/lacq has been converted to -laj/-lac,
To access the old rush behavior for these flags, use:
setenv RUSH_PRE102_20 1
> ENHANCE: irush modified: 'All Hosts' added, help improved.
> ENHANCE: get_ether added to win/nt
Release Notes for 102.17c - 02-05-01
--------------------------------------------------------------------------
> ENHANCE: rush -lajq (List All Jobs Quick) added. Helps get listings
of all jobs *quickly* on large networks. Includes 'no response' summary.
> ENHANCE: rush -lacq (List All Cpus Quick) added. Helps get listings
of all jobs *quickly* on large networks. Includes 'no response' summary.
> ENHANCE: irush
o Added buttons for new 'all jobs/cpus quick' commands.
o Added 'Select All Frames' to Frame Controls' "Select All..." choices.
> ENHANCE: rush -status now reports machines that didn't respond
in a small summary at the bottom of the report.
> FIX: rush tmp dirs are now removed as root, incase pre-existing tmp
directories owned by another user was left behind. (GVFX)
> FIX: daemons clean up stale tasks automatically by reawakening tasks
in JobPass/CpuPass states, based on hours specified in rush.conf:
taskcleanhours #[,#..]
Includes anti-network storming timer to offset the cleanup up to
40 minutes after the hour, based on each host's index in the host
list. (BLUESKY)
> ENHANCE: Added pid to cpu.acct logs. See cpu.acct for details.
Release Notes for 102.17b - 02-02-01
--------------------------------------------------------------------------
> *FIX: jobtids/cputids are now uniquely assigned, even through daemon reboot.
This fix prevents problems with 'stuck frames' after a daemon is
rebooted, followed by a job quickly submitted to it.
Release Notes for 102.17a - 01-26-01
--------------------------------------------------------------------------
> ENHANCE: Host groups can now expand to include ALL CPUS on each host.
This is configurable via rush.conf's new 'expandallcpus' flag.
> ENHANCE: rush.conf: added 'expandcpus' flag.
> *FIX: During submit, job's ram value was not getting set
properly for host group specifications. During task creation stage
of host group expansions, ram was not being set.
Release Notes for 102.17 - 01-18-01
--------------------------------------------------------------------------
> 'rush -logdir' added
> 'rush -logflags' added
Release Notes for 102.16c - 01-13-01
--------------------------------------------------------------------------
> NEW: major irush gui fixes: IRUSH 0.90;
Help mostly done
Repeat
Run menu working, and running commands
Winnt thread bug fixed; String declaration moved INSIDE locking code
> ENHANCE: setenv RUSH_JOBID "tahoe-34 tahoe-35 erie-15"; rush -lj
..will now list jobs on "tahoe" and "erie", instead of local workstation.
> FIX: 'rush -status' percentages now match 'rush -lj'
Release Notes for 102.16b - 01-04-01
--------------------------------------------------------------------------
> NEW: irush gui now included in releases
> ENHANCE: 'rush -lf' causes daemon to fork child to handle sending data
> ENHANCE: 'rush -lf' and all other long reports now come up quickly (esp. sgi)
due to improved TCP buffering while reading 'line at a time' data.
-- added TcpFgetsNoCRLF() with recv() buffering
> *FIX: 'rush -log' now uses TCPSENDEXIT() instead of TCPSEND()
to do an Exit instead of a return. Problem: dupe forked daemon
created if client killed during log transmission. (UNIX ONLY)
> Various fixes to irush gui and www-rush for ISI.EDU install.
Release Notes for 102.16a - 12-16-00
--------------------------------------------------------------------------
> ENHANCE: 'rush -uping' defaults to one ping sent, and waits only 5 secs.
(Previous default behavior was 5 pings, 10 second waits)
> ENHANCE: 'rush -af' now sorts frames into list, rather than appending.
You can use reorder if you want to append them.
Release Notes for 102.16 - 12-12-00
--------------------------------------------------------------------------
> FIX: 'rush -lj tahoe tahoe' would cause a 'list range error';
intertwined for() loop variables [t] and [r] repaired.
> INTERNAL: $G_frames by default is disabled in www-rush
> INTERNAL: Frand_NET() does one time srand()
> INTERNAL: Added File and Lic classes, license system modified
> ADDITION: 'rushd -hostid' and 'rushd -validate'
Release Notes for 102.15b - 12-04-00
--------------------------------------------------------------------------
> FIX: Added <<ERR>> to all TCP message parsing errors, so exit status
is returned to user.
Release Notes for 102.15a - 12-04-00
--------------------------------------------------------------------------
> FIX: MS version of code only: a bug introduced in 102.14
(addition of 'rush -reserve') caused CreateProcess()
not to check error codes. rushd.log contains errors
"WaitForSingleObject(0): The handle is invalid."
> FIX: 'rush -jobnotes -' will clear jobnotes.
You couldn't clear them previously.
> BUILD: Makefile's and build scripts use VERSION file now
> NOTE: irush gui in alpha -> beta transition state.
Release Notes for 102.15 - 11-27-00
--------------------------------------------------------------------------
> minor release bumped for BlackMountain eval.
Release Notes for 102.14a - 11-15-00
--------------------------------------------------------------------------
> ADDITION: 'rush -log' created
> ENHANCE: 'rush -ljf' now reports bad jobids, instead of ignoring them
> ENHANCE: 'rush -lff' added line breaks between frames
> ENHANCE: 'Jobid' column added to 'rush -lf'
> ENHANCE: If a uid outside the uid range is used, rush complains right away.
(unix only)
> ENHANCE: www-rush: added an 'End' button to the Jobs screen, added docs
for the Job Controls screen, added a 'Help' message at the top of the
www-rush screen. 'Frames' version now officially supported.
> ENHANCE: if RUSH_JOBID is set to "", behaves as if not set at all.
(To support behavior in irush)
> NOTES: irush (GUI) is being written. Tweaks to rush for support.
Release Notes for 102.14 - 11-15-00
--------------------------------------------------------------------------
> BUGFIX: percentages in -lfi/-lj reports now shows percentages where
0<x<1 are shown as 1, and 100>x>99 are shown as 99.
> ADDITION: cpu.acct includes exit code/signal number of process
> BUGFIX/OPTIMIZATION: First job took ~30secs to start; tasks in IDLE/NAK.
Was occuring when job server was both not serving any jobs AND
not rendering any frames, and someone submits the first job.
> ADDITION: 'rush -reserve' added.
Lets people reserve cpus, eg. 'rush -reserve tahoe=2@200'.
Optional 'ram' value can be included to reserve a particular
amount of ram as well.
> ENHANCE: rush -dump/pause/cont takes 'username[@host]' as argument,
eg. 'rush -dump fred' dumps all jobs on localhost owned by fred.
and 'rush -dump fred@host' dumps fred's jobs on a particular host
> ENHANCE: rush -lj +any prints "hostname\r" if stdout isatty.
Similar to 'rush -laj' so you can see which hosts it gets stuck on.
> ENHANCE: rush -ac/-rc/-an/-rn all include jobid in output report,
and 'extra blank line' report output bug fixed with -rc.
> BUGFIX: Fixed help message for 'rush -rc'; included '.tid' syntax
Release Notes for 102.13a - 11-0?-00
--------------------------------------------------------------------------
> ENHANCE: -deltaskfu cleans up stuck frames (it didn't before)
> BUGFIX: Fixed help messages for -deltaskfu
> ADDITION: rush -usend added for admin use only.
Release Notes for 102.13 - 10-15-00
--------------------------------------------------------------------------
> ADDITION: Added "host:iface" to rush hosts file so one can specify which
network iface to use, eg. use ethernet iface instead of default atm.
> BUGFIX: chdir(tmpdir) after tmpdir created (UNIX)
> BUGFIX: WAIT for fork()ed rmdir to finish before creating new copy
Release Notes for 102.12a - 10-1?-00
--------------------------------------------------------------------------
> FIX: 'rush -criteria -' disables any previous criteria
> FIX: Fixed some usage errors in 'rush -help' docs
> ENHANCE: Added 'rush -fullhelp'
> FIX: Daemon installs as 'chmod 4750' instead of 4755 (to prevent accidental
execution by TDs)
Release Notes for 102.12 - 10-11-00
--------------------------------------------------------------------------
> FIX: Fixed 'waitfor' field in 'Job Attributes'; was being ignored
> FIX: Fixed 'waitfor'; wasn't kicking in frames once job entered RUN state.
Job::SetState() now wakes up all JobPass tasks.
Release Notes for 102.11 - 10-08-00
--------------------------------------------------------------------------
> FIX: Fixed problem with 'rush -title' not changing title in tasks (job was ok)
> FIX: 'rush -command' and 'rush -donecommand' were not working; fixed
> FIX: Fixed multiple retransmissions of CpuPass (during "No Available Ram") in
Sched::_AdvertiseIdlePriGroup() causing these numerous ALERTs in logs:
ALERT Ignored Frame Arbitration 'j2c-frmarb vaio-488 3 2 2 2 CpuPass1
"Ram unavailable on nt (150>106)" ': seqid mismatch [..]
..Skips non-IDLE tasks in second loop, where Sched::CpuPass() changes
state of task, but does not remove it from tsorts array. In small amounts
these msgs are benign; they just mean the task chaged state (frm got
done) between the msg transmission and the remote ack.
> 'rush -down' now removes tasks from remote schedulers (tasklist)
since now JobTasks et al. never time out.
> Changed CpuPass acking: was jobserver acked w/CPUPASS1, now CPUPASS2
> Fix for error "Task 'CpuPass2' ignored for non-existent frame 0" if
cpuserver rejects a new task before a frame is assigned.
> All methods in Job.C refering to cpus[].GetTasks() were moved to Cpu class
to aid in centralizing GetTasks() references for "cpus-busy" dumps.
> TODO: Reboot of a job server should notify all remote tasklists that
the job is no longer valid, to flush inactive JobPass/CpuPass tasks
from the scheduler. Currently you must 'rush -down' to clean them up.
Release Notes for 102.10 - 09/29/00
--------------------------------------------------------------------------
> Added 'State' to rush -ljf
> add -waitfor and -dependon
> Added 'rush -cat[o]log' to rush & www-rush
> Added 'rush -try'
> Fix to String.C: mallocsize=0, List library bug
> Tweaked rush exit codes values: -1 -> 1
Version Description
------- ------------------------------------------------------------------
102.00 -- 09/27/00
-- Added 'dependon'
-- Added Averages and ETAs
-- Fixed %d -> %lu for elapsed time string conversions
-- 'endl's added to SECURITY messages (eg. uid range errors)
causing long lines in the logs.
-- You can now -dump or -end a job in the Wait state
(you had to pause it first) Also fixed related error messages.
-- Added rush -command, -donecommand so these can now be tweaked
on the fly while a job is running.
-- Added hostname to daemon boot log messages, to catch problems
if hostname changed while daemon running.
101.84d -- String.C tweaked for ignorecase in hostnames
-- JobPass no longer has a timer; job re-awakens via UnPass messages
-- DNS: fixed issue with local hostname being foo.bar.com,
but only 'foo' configured in rush hosts.
-- During 'rush -online', ensure jobs rescheduled more quickly
-- www-rush:
o Popen() now reports errors
o fixes for add/remove cpus
o new docs
o JobModification: menu and all submits have docs now
101.84c -- 09/12/00 --
-- Fix: DNS CNAME's are now cached on the fly. Host.C modified.
-- Added 'rush -lacf'
101.84b -- 09/10/00 --
-- Added ntrushuid/gid to control uid/gid values when jobs
submit from NT *and* run under unix.
-- Strengthening. Added double checks of min/max uid/gid's.
No problem existed, just being paranoid.
-- 'rush -d a' now precedes conf file loading, so debugging
can be applied to the conf file loading process. Also,
logflags commented out from conf file, to avoid overriding
command line.
101.84a -- Fix for microsoft log rotation; G_conf.log was being
closed but not re-attached()
-- Fix: 'rush -que 1-10' changes didn't wake up JobPass state
on cpu servers.
101.84 -- 09/06/00 --
-- Added 'rush -rc .<jobtid>'
-- Added JobTid to 'rush -lc' report
% rush -lc
CPUSPEC[HOST] STATE FRM PID JOBTID ELAPSED NOTES
vaio=3@11 Busy 0001 4659 1 00:00:07
^^^^^^
-- www-rush: Fixed bug with Job Modification -> Cpus -> (all screens)
where multiline text caused embedded \r\n's in 'rush -opt' commands.
-- www-rush: Fixed bug with Reports -> Cpus -> Remove Cpus
removing entire specs, instead of individual specs.
-- FIXED 'PAUSE/CONT' PRIORITY BUG (GVFX). When a high priority job is paused,
then later continued, it was not being sorted back into the list;
it remained at the bottom.
-- FIXED LOW PRIORITY SNEAK BUG. A single job in single priority grouping
with multiple tasks only issued one task, instead of all of them.
Thus, lower pri jobs would sneak in.
101.83 -- 08/26/00 --
-- Removed 'REPORT= +Frames+' message from www-rush
-- 'disablefu' added to rush.conf (BLACK LOGIC).
-- Added 'prioritystr' to Process.[CH], so -status can output
priority for running processes
-- '-status -s secs'; secs checked if >=1, else error
-- Fixed jobs with single frame not rendering right away.
If killer process has enough ram to use a machine, but
cpu(s) are busy with indefeatable cpus, frame will
take, and then requeue quickly. On single frame jobs,
this means the single frame won't render for a few minutes.
** BLUESKY DECALPHA RENDERFARM FIXES **
-- Added # busy frames to 'j' field of 'rush -status'
-- Add 1.13d input buffer absorption to rushd.C,
and tweaks for 'inmaxmsg' to Conf.[CH] and etc/rush.conf
-- Truncate domain names from framelist
-- Fix problem where sometimes frame gets DONE without
showing retries or pid. This was due to RUN sometimes
being missed, then process completes. So frame goes straight
from START -> DONE. Moved retry increment to Frame::Done(), and
added pid as argument, so pid doesn't get lost.
-- Added UnPass state after JobPass/CpuPass timer expirations.
solves silly messages about sequid mismatches after a job completes, eg:
>> ALERT Ignored Frame Arbitration 'j2c-frmarb va-12 2 3 697 1332 Idle ': seqid mismatch
May also fix problem with occasional stuck Start states.
-- Fixed problem with single frame renders not 'taking' (BLUESKY)
-- rush -status tweaks:
'h' host record added
'p' records appear for idle cpus (fields '-'ed out)
'p' records now include priority
'd' record includes #cpus configured
'-s secs' the secs value if <1 returns an error
101.82a -- (CENTROPOLIS) outbound socket()s now bind() to localhost iface.
To ensure packet srcaddr same as localhost's, esp. on hosts
with multiple (ethernet/hippi/fddi, etc) interfaces.
-- Fixed WINNT bug with /dev/null -> nul; "logdir -" yields:
/dev/null: The system can not find the path specified.
101.82 -- 'rush -exitbat <code>' for MSDOS batch scripts to use
-- 'rush -an/-rn' takes host groups for arguments
-- S99rush script added
-- www-rush: cpus modification screen added
-- www-rush: 'rush -status' screen format improved
-- 08/05/00 --
101.81 -- The -tasklist report fields have been better aligned
-- Added automatic log rotation; 'logrotatehour' to rush.conf file
-- When submitted job asks for cpus that are offline, shows 'offline'
in "rush -lc" report. (Modified "newtaskack" to include a msg arg)
-- Fixed 'rush -status';
> memcpy() dest/src swap
> added #cpus total to 'd' report
> 4 digit padding for frame number
-- save offline/online state in reboot file
-- Added system("kill <pid>") to microsoft code to ensure killing
chalice correctly.
-- Supported -uping and -status under WinNT
-- Fixed hostname alignment in -uping
-- Fixed bug in -ramlist report for total ram (Sched.C)
-- Heavy mods to Tcp.C; added rresvport() support under WinNT,
added an MS compat version of rresvport()
-- Fixed MS error messages
101.80 -- rush -lj/ljf can now use host *OR* jobid
101.71 -- fixed close() vs closesocket() in NT version, which caused
slow mouse, and left frames QUE in middle of job
-- UPING is now only using one port. Phased out the
'clientport/serverport' stuff.
101.70 -- fixed 'echo ID:; id -a' debug msgs in etc/template
-- NT version handles log file redirection