Thanks Greg, this is the first time I have seen this happen, and only
because we write the frame sizes out to job notes so the uses can tell if a
frame wrote correctly. Also if a none standard frame size in encountered
automatically re-queue the frame, never host that CPU, and mail an alert.
In one case though a batch job of 360 frames (!) was submitted that output
every frame size to an array and then output that lot to the job notes. Not
sure how many characters, but certainly more than 1000. We have changed the
code here now to stop that happening, so it's not an issue for us, but I
thought it was interesting.
A frame note that long is not really what was intended when we set it up :)
|-----Original Message-----
|From: Greg Ercolano [mailto:erco@(email surpressed)]
|Sent: Wednesday, 7 December 2005 11:00 AM
|To: void@(email surpressed)
|Subject: Re: Max field size of job notes
|
|[posted to rush.general]
|
|Greg Ercolano wrote:
|>> Last night we had a couple of jobs that "accidentally" created very
|>> large frame notes that appeared to crash rushd. [..]
|>
|> Hmm, the strings should be dynamically allocated, but you might
|> be encountering a line length limit of 1000 chars imposed, due
|> to the way the varargs stuff works. [..]
|>
|> I'll do some tests to verify, [..]
|
| I did some tests.. seems lines can get pretty darn long before
| anything freaks out.
|
| But I think what I should do is enforce some line limits
| which is surely better than just enlarging the buffers.
|
| I looked at the code, and it actually /should/ be enforcing
| line limits, but I think something is causing ultra long lines
| to potentially sneak through.
|
| I'm about to come out with a maintenance release (102.42a1),
| I'll be sure to enforce some line limits to prevent crashing
| the daemons.
|
| Some tests:
|
|% rush -lf gen.25
|STAT FRAME TRY HOSTNAME PID JOBID
|START ELAPSED NOTES
|Done 0001 1 ontario 6285 geneva.25
|11/15,09:21:15 00:00:11
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|123456789|123456789|123456789|123456789|123456789|12345
|6789|123456789|123456789|123456789|123456789|123456789|12345678
|9|123456789|123456789|123456789|123456789|123456789|123456789|1
|23456789|123456789|123456789|123456789|123456789|123456789|1234
|56789|123456789|123456789|123456789|123456789|123456789|1234567
|89|123456789|123456789|123456789|123456789|123456789|123456789|
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|123456(900)|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|12345678
|9|123456789|123456789|123456789|123456789|123456789|123456789|1
|23456789|123456789|123456789|123456789|123456789|123456789|1234
|56789|123456789|123456789|123456789|123456789|123456789|1234567
|89|123456789|123456789|123456789|123456789|123456789|123456789|
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|---------|---------|---------|---------|---------|-----
----|---------|---------|---------|---------|---------|---------|---------|-
-----|---|---------|---------|---------|---------|---------|
|Hold 0002 0 - 0 geneva.25
|00/00,00:00:00 00:00:00
|Hold 0003 0 - 0 geneva.25
|00/00,00:00:00 00:00:00
|Hold 0004 0 - 0 geneva.25
|00/00,00:00:00 00:00:00
|Done 0005 1 ontario 6305 geneva.25
|11/15,09:21:53 00:00:11
|Hold 0006 0 - 0 geneva.25
|00/00,00:00:00 00:00:00
|Hold 0007 0 - 0 geneva.25
|00/00,00:00:00 00:00:00
|Hold 0008 0 - 0 geneva.25
|00/00,00:00:00 00:00:00
|Hold 0009 0 - 0 geneva.25
|00/00,00:00:00 00:00:00
|Hold 0010 0 - 0 geneva.25
|00/00,00:00:00 00:00:00
|Done 0011 1 ontario 6321 geneva.25
|11/15,09:22:29 00:00:11
|
|% rush -ljf gen.25
| Jobid: geneva.25
| State: Run
| ActState: Run
| RebootId: 69
| Title: SECOND_B-D
| DefPriority: 1
| LogDir: -
| LogExt: -
| LogFlags: -
| ImgCommand: -
| Ram: 0
| Nice: 10
| MaxCpus: 0
| MaxTime: 00:00:00
| MaxTimeState: que
| LicPauseSecs: 00:01:00
| LicPauseTimer: 00:00:00
| FrameFlags: off
| Command: rush -sleep 10
| ChkCommand: -
| JobDoneCommand: -
|JobStartCommand: -
| JobDumpCommand: -
| AutoDump: off
| WaitForState: dump
| WaitForTime: -
| User: erco (1004/1004)
| DoneMail: -
| DumpMail: -
| StartDate: Sun Nov 20 06:05:43 2005
| EndDate: -
| Elapsed: 393:48:00
| Frames: 11
| FramesQue: 0
| FramesRun: 0
| FramesDone: 3
| FramesFail: 0
| FramesHold: 8
| Cpus: ontario=1@1
| DependOn: geneva.22
| DependOn: geneva.23
| Dependents: geneva.26
| Dependents: geneva.26
| Notes[0]:
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|123456789|123456789|123456789|123456789|123456789|12345
|6789|123456789|123456789|123456789|123456789|123456789|12345678
|9|123456789|123456789|123456789|123456789|123456789|123456789|1
|23456789|123456789|123456789|123456789|123456789|123456789|1234
|56789|123456789|123456789|123456789|123456789|123456789|1234567
|89|123456789|123456789|123456789|123456789|123456789|123456789|
|123456789|123456789|123456789|123456789|123456789|123456789|123456789|
| Notes[1]:
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|123456789|123456789|123456789|123456789|123456789|12345
|6789|123456789|123456789|123456789|123456789|123456789|12345678
|9|123456789|123456789|123456789|123456789|123456789|123456789|1
|23456789|123456789|123456789|123456789|123456789|123456789|1234
|56789|123456789|123456789|123456789|123456789|123456789|1234567
|89|123456789|123456789|123456789|123456789|123456789|123456789|
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|
| Notes[2]:
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|123456789|123456789|123456789|123456789|123456789|12345
|6789|123456789|123456789|123456789|123456789|123456789|12345678
|9|123456789|123456789|123456789|123456789|123456789|123456789|1
|23456789|123456789|123456789|123456789|123456789|123456789|1234
|56789|123456789|123456789|123456789|123456789|123456789|1234567
|89|123456789|123456789|123456789|123456789|123456789|123456789|
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|123456789|
| Notes[3]:
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|123456789|123456789|123456789|123456789|123456789|12345
|6789|123456789|123456789|123456789|123456789|123456789|12345678
|9|123456789|123456789|123456789|123456789|123456789|123456789|1
|23456789|123456789|123456789|123456789|123456789|123456789|1234
|56789|123456789|123456789|123456789|123456789|123456789|1234567
|89|123456789|123456789|123456789|123456789|123456789|123456789|
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|123456789|123456789|123456789|123456789|123456789|12345
|6789|123456789|123456789|123456789|123456789|
|123456789|
| Notes[4]:
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|123456789|123456789|123456789|123456789|123456789|12345
|6789|123456789|123456789|123456789|123456789|123456789|12345678
|9|123456789|123456789|123456789|123456789|123456789|123456789|1
|23456789|123456789|123456789|123456789|123456789|123456789|1234
|56789|123456789|123456789|123456789|123456789|123456789|1234567
|89|123456789|123456789|123456789|123456789|123456789|123456789|
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|123456789|123456789|123456789|123456789|123456789|12345
|6789|123456789|123456789|123456789|123456789|
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|
| Notes[5]:
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|123456789|123456789|123456789|123456789|123456789|12345
|6789|123456789|123456789|123456789|123456789|123456789|12345678
|9|123456789|123456789|123456789|123456789|123456789|123456789|1
|23456789|123456789|123456789|123456789|123456789|123456789|1234
|56789|123456789|123456789|123456789|123456789|123456789|1234567
|89|123456789|123456789|123456789|123456789|123456789|123456789|
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|123456789|123456789|123456789|123456789|123456789|12345
|6789|123456789|123456789|123456789|123456789|
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456789|
|
|% rush -fu geneva.25 -notes
|1:"123456789|123456789|123456789|123456789|123456789|123456789|
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|123456789|123456789|123456789|123456789|123456789|12345
|6789|123456789|123456789|123456789|123456789|123456789|12345678
|9|123456789|123456789|123456789|123456789|123456789|123456789|1
|23456789|123456789|123456789|123456789|123456789|123456789|1234
|56789|123456789|123456789|123456789|123456789|123456789|1234567
|89|123456789|123456789|123456789|123456789|123456789|123456789|
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456(900)|123456789|123456789|123456789|123456789|
|123456789|123456789|123456789|123456789|12345
|6789|123456789|123456789|123456789|123456789|123456789|12345678
|9|123456789|123456789|123456789|123456789|123456789|123456789|1
|23456789|123456789|123456789|123456789|123456789|123456789|1234
|56789|123456789|123456789|123456789|123456789|123456789|1234567
|89|123456789|123456789|123456789|123456789|123456789|123456789|
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|---------|---------|---------|---------|---------|--
-------|---------|---------|---------|---------|---------|---------|--------
-|---|------|---------|---------|---------|---------|---------|"
|
|% rush -fu geneva.25 -jobnotes
|"123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|123456789|123456789|123456789|123456789|123456789|12345
|6789|123456789|123456789|123456789|123456789|123456789|12345678
|9|123456789|123456789|123456789|123456789|123456789|123456789|1
|23456789|123456789|123456789|123456789|123456789|123456789|1234
|56789|123456789|123456789|123456789|123456789|123456789|1234567
|89|123456789|123456789|123456789|123456789|123456789|123456789|
|123456789|123456789|123456789|123456789|123456789|123456789|123
|456789|123456789|123456789|123456789|123456789|123456789|123456
|789|123456789|123456789|123456789|123456789|123456789|123456789
||123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|123456789|123456789|123456789|123456789|123456789|12345
|6789|123456789|123456789|123456789|123456789|123456789|12345678
|9|123456789|123456789|123456789|123456789|123456789|123456789|1
|23456789|123456789|123456789|123456789|123456789|123456789|1234
|56789|123456789|123456789|123456789|123456789
||123456789|123456789|123456789|123456789|123456789|123456789|12
|3456789|123456789|123456789|123456789|123456789|123456789|12345
|6789|123456789|123456789|123456789|123456789|123456789|12345678
|9|123456789|123456789|123456789|123456789|123456789|123456789|1
|23456789|123456789|123456789|123456789|123456789|123456789|1234
|56789|123456789|123456789|123456789|123456789|123456789|1234567
|89|123456789|123456789|123456789|"
|
|--
|Greg Ercolano, erco@(email surpressed)
|Rush Render Queue, http://seriss.com/rush/
|Tel: (Tel# suppressed)
|Cel: (Tel# suppressed)
|Fax: (Tel# suppressed)
|
|