TinSoldier's tags:
I don't want to break my arm patting my own back. But you know what? Sometimes a person has to feel satisfied with what he does.

For those of you who don't know, I fix electronic circuit boards for a living. Not in consumer equipment, but in industrial equipment. My company manufactures and repairs tester equipment for the semiconductor industry. I'm sure that many of the integrated circuits in your computer or your cellphone or in your VCR or DVD player were tested on my company's testers before being sent out to the manufacturers who build the computer motherboards and cameras and phones and VCRs and DVDs.

Anyhow, my job is to test the circuits that go in the testers. You might call me a "meta tester" in fact. Heh.

So my job is a complex mix of using computer software to run tests on the boards and to control them and using simpler test equipment like multimeters and oscilloscopes and spectrum analyzers and what not to trace faults down to the actual failing component. Much of the time the boards test themselves through feedback mechanisms and the software can tell us what failed. But not always.

So in a way my job is a lot like CSI. Only less glamorous and maybe a bit easier.

The worst problems are the intermittent problems. They are the bane of technicians of every ilk -- electronics, electricians, plumbers, auto mechanics, you name it. The problem only shows up randomly and never often enough to gather enough data to make a positive decision without guessing.

That's the kind of problem that I've been working on for the past couple of weeks. We've got this circuit board that is a computer in its own right. The symptom is that it loses communication with the rest of the system intermittently, and there is no indication as to why it is losing communication. I mean, once you reset the board in order to reestablish communications with it you lose whatever reason it failed.

So reaching above and beyond the call of duty, I find the tester software on the company network so I can read it and better understand what everything is doing. I learn a little bit here and there. Despite missing components of makefiles and unset paths and stuff I figure out how to build my own copy of the test program that includes some print statements that I can use to help me figure out what is going on. I learn a little bit here and there.

(Note: This particular circuit board is over ten years old; the previous software revision was probably three or four years ago, and some of the software is nearly twenty years old).

So I keep turning over rocks between the software and the hardware, trying different experiments and trying to either memorize or note down the results. And then finally today I notice -- an important part of the board's operating system is being loaded into a section of memory that I know that we have had problems with! I mean, until this point I didn't know that that section of memory was even used for programs, much less for the OS! It was like a ray of light from the heavens!

I had already replaced a few of the chips in that memory section because of hard failures (not intermittent). So this afternoon I replaced the other chips in that section and set the board up for looping on the test over the weekend. It usually fails within twenty minutes or so -- it was about twenty or thirty minutes before I left for the day.

If the board is still running without error on Monday, I will be so stoked and my ego will grow at least three sizes too big. If it has failed, then I will be crushed like pineapple.



del.icio.us Digg reddit StumbleUpon

Comments

  • Fallyn said on Feb 29, 2008....
    well, here's hoping for ego growth.

    cause...well....smooshed pineapples are messy and unappetizing.
  • D6fer said on Feb 29, 2008....
    cool!.....I could use your expertise!.......I run into board problems with espresso machines from time to time......status quo in the industry is that you replace them....always.......but I know they can be repaired.....I'm just not sure how.
  • TinSoldier said on Mar 01, 2008....
    D6fer, they probably are repairable, but is it worthwhile to do so?

    It depends on how long it takes and how much it costs to test, repair, test a broken board compared to how much it costs to manufacture a new one.


  • D6fer said on Mar 01, 2008....
    most of the time we are talking a blown relay on a motherboard.....just a matter of locating which one and successfully replacing it.....I have done it on older boards where the relays were bigger, clear ones.....but newer ones are smaller and you cant see inside them.....so finding the problem is where I have the problem there.
    Another instance, more recently, was with touch pad controls that suffered water damage......everything is still pretty much intact.....but water scale is present, and I believe that is causing the problem.
  • TinSoldier said on Mar 01, 2008....
    To troubleshoot relays that you cannot see through -- use a magnet or a battery to activate the relay and an ohm meter to check for continuity if you have a pinout of the relay.
  • D6fer said on Mar 01, 2008....
    can you do that while it is on the board?
  • TinSoldier said on Mar 01, 2008....
    You should be able to. It kinda depends, you'd have to experiment a bit.
  • D6fer said on Mar 01, 2008....
    yeah I'll have to......my electronics knowledge is completely non formal.....just what I've picked up from playing around with stuff.....I have a pretty good ohm meter...its a fluke....sadly though I don't know all of the functions...I can check continuity.....voltage....after that I get confused a bit.
  • TinSoldier said on Mar 01, 2008....
    Heh. Voltage and resistance/continuity are about all you need. Almost no one -- at least in my line of work -- checks for current directly.

    If you have any questions, though, just let me know.
  • D6fer said on Mar 01, 2008....
    thanks!

  • TinSoldier said on Mar 04, 2008....
    Update: I was right. When I got into work Monday morning, the board was still running.

    That felt pretty good.
  • silverwhisper said on Mar 06, 2008....
    o, very nice, TS! i can definitely relate, esp given some of the problems i've had recently w/ that project! :>

    so...three sizes too big, eh? shall we call you mr. grinch? :>

    ed
  • Madd-Shame said on Mar 07, 2008....

    I followed much of what you wrote until... My company manufactures and repairs tester equipment for the semiconductor industry... then I was totally lost but I do understand projects and I hope yours does well.

    I am impressed at how easily you can explain your complicated work. Ever thought about teaching?

    Madd Shame

  • TinSoldier said on Mar 07, 2008....
    I am impressed at how easily you can explain your complicated work. Ever thought about teaching?

    Hmm. Occasionally.

    I have actually taught (or "trained") others as part of my career both in and out of the military. But except for a few crazy ideas in my head about fifteen years ago or so, I've never really seriously considered it.

    But thanks for the compliment!


Comment on "Perseverance pays off"

troubleshooting work teaching industry (Click to add tags below)

(Separate tags using commas, for example: New York, dating, vegetarian)
Comment Anonymously

Today is T day at work....
Leavin' work now ......
If you know how to multi task....
Wow, it's Thursday and I haven't, as of yet, gotten past my Monday passive/aggressive mentality...sigh. Thursday, it can't be past three pm on Monday. I just recently returned from leave and the whole mentality of being at work can be described as being...
I suppose, anyway, just quit looking at my coffee ... that'll get you into trouble and you don't want trouble....