8 Mistakes Your QMS Makes

not one of the 8 Mistakes, but not a good one to make
Too Highbrow?

8 Mistakes
A Quality Management System – any management system, is only as good as the sum of its parts. Lots of things go right, and we all try our best. Yet, out in the world I see the same mistakes over and over again. I want to share those things with you now.

Here they are, in a particular order.

1st of 8 Mistakes: Focusing on Manufacturing

A business is a complicated thing. No kidding, it really is. But it is too easy to think that the sections of it that appear to actually produce tangible objects are the most important. Quite simply – it’s all important.

The more you want to get the most out of everything you’ve got, the more important everything you’ve got becomes.  If you own a racehorse (and who doesn’t?) it’s easy to think the galloping equine beast is the main… workhorse. But what about the shoes, and the guy who puts them on? (it’s a farrier, but that sounds highfalutin, so I didn’t say it).

And there’s the jockey- and the jockey’s Jockeys, the nutritionist, stable boy – and a whole slew of influential entities. If any of those are non-optimal, do you think the whole system can be optimal?

Many companies I go to have continual improvement projects related to assembly areas but neglect sales departments, or purchasing groups or human resource departments. There are always better ways of doing things, mostly because “better” is an evolving concept. Options need to be considered and tried out in all areas – not just manufacturing.

I’ll take a second to cover the frequent exception. Design functions, along with production, are often targeted for streamlining. Or rather, they become streamlined over time. It may be a stereotype, but engineers tend to find optimum paths somewhat organically. Or they are at least interesting paths.

This may be influenced by two factors. One is that 9001 and the related standards that share design and development pieces with it, provide a good skeleton that hasn’t really changed in lots of years. It’s just might be a  common-sense starting point or the successful modifications to it have traveled from company to company along with the migrations of engineers.

The other factor is, I believe, the cerebral nature of the activity itself. When you get a bunch of brains focused on development, the tendency for self-development; the development of the organism that’s developing – is a genetic inclination. It’s a bit like cleaning your office instead of working – but in a good way.

There’s more to businesses than design or manufacturing; opportunities for improvement abound. One of my favorite quotes encapsulates and summarizes this idea well, “How you do anything, is how you do everything.”

2: Fixing Problems Without Understanding Cause

Up here in the Great White North, we like to think we have “Yankee Ingenuity”. We’re really good at fixing things using creative approaches. Duct tape and elbow grease.

But sometimes we spend lots of effort on the solution, and not enough resource figuring out why the problem happened in the first place. Fortunately, when the problem happens again – we can fix it right quick. Third time’s the charm! Sound familiar?

Some of this is because each of us carries a sort of personal toolbox. We tend to do the things we’re good at. One apt phrase is, “When you know how to use a hammer, everything looks like a nail.”

Fortunately, not only are there different types of hammers, there are other tools that can be brought to good use (what did you call me?!). These help an organization get to the root of the problem, or to a main cause. Since each of them could span a blog entry of their own I won’t do much more than list them here.

  • 5 Whys Analysis – Asking “why” multiple times until the culprit is found. Make it so the culprit can’t come back
  • Change Analysis – Won’t always generate root cause, but will arrive at a cause. Six step process worthy of further investigation.
  • Barrier Analysis – Identifies barriers used to protect a target from harm. The terms are flexible; think shoe/foot/glass. Glass is the threat, shoe is the barrier, foot is the thing to protect. Foot is cut – how, specifically, did the shoe fail?
  • Ishikawa (fishbone) diagrams – or any kind of tree diagram. In general, each branch of the tree, or each branching bone of the fish, adds to the understanding of the factors involved. By understanding the factors, countermeasures can be considered.

And on and on – There are so many tools available it just doesn’t make sense to start with a solution that may have nothing to do with the problem.

3: Too Many Corrective Actions

While it may seem counter-intuitive to a continual improvement mindset – it really isn’t. A mature management system is very good at collecting data, then by analyzing that data, it can target areas for improvement.

Writing a NCMR (Non-Conforming Material Report) as if it was a CAR (Corrective Action Request) is a terrible resource-waster. Do this instead when you find nonconforming material:

  • Capture the data and look for common failure modes
  • Create a set list of failure modes (you may need to adjust this over time)
  • Make a Pareto chart of the failure modes
  • Create a CAR for the big hitter.
  • Do it again for the next biggest hitter.

If you find the same issues continue to arise then see Mistake number 2, above.

Corrective actions are indeed that avenue to improvement but they need to rise above the level of the noise. The noise is the inherent variability in the system; few things are perfect.

Find the trends, then with a healthy use of the corrective action tools like those listed above – focus the limited resources toward determining root cause.

4: Not Auditing Internal Audits

Internal audits should be deep, and thorough and, dare I say – brutal.  With internal audits, you won’t make any friends by making friends. Tough love.

The whole system should be checked against existing procedures (documented, or not) and against the requirements of your standard of choice.

The audits should be planned, that plan should be based on some analysis of the status and importance of the areas to be audited.

They should be carried out by qualified individuals who are independent of the function being audited. When problems arise, those corrective actions must be taken without undue delay and the cause of the findings corrected and verified as effective.

Sounds lovely, doesn’t it? Not only do you need to do those things in order to have an effective internal audit program – but the standard requires that you do those things.

A frequent “gotcha” here is if you have a contractor perform your audits. One of the rules is that the auditor must be independent of the thing being audited. Sometimes the contracting company can provide another auditor specifically to audit that function – that could work. Or, you could, given the proper training and procedure, audit the internal audit process as part of Management Review.

Or you could have someone internal to the company and from a department typically outside of the QMS – like accounting, do the audit of audits.

If the audit process itself isn’t checked to make sure it continues to do all of the above, then all of your credibility goes straight out the window. And in through the front door comes a written nonconformance from your friendly ISO auditor.

5: No Dashboard, No Goals

For this, I refer you to last week’s post on Quality Metrics.

A Dashboard is simply a frequently updated collection of the upper level metrics presented in a way that is quickly and easily digested. Goals for these metrics should be evident. Where the trend of the data is moving significantly away from the goal then there should be an action plan to adjust the trend.

Action plans have owners, they have something that needs doing – and they have accountability.

Sometimes the dashboard includes a collection of charts along a frequently traveled hallway. Who needs to see these things? Anyone that can influence the data – that often means everyone in the organization.

If you do have one of these metrics boards/dashboards do make sure the date is current please.

Nothing says “We really don’t care what’s going on, nor do we care if no one else knows what’s going on” like charts that are four months out of date.

Am I preaching to the choir? Sing with me, my friend.

6: Rework Without Collecting Data

This is fairly common, meaning I see it once or twice a month (I do somewhere around a hundred audits a year; three to five audit days per week).

Example? Take a manufacturing floor, someone builds something – let’s use a contract manufacturer. The assembler does his job and sends it off to an in-process or final inspection step.

The inspector does a nice inspection, using documented and established inspection criteria. They find a missing screw – and record it on their inspection sheet or enter it into a database. They have a box of the correct screws and they correct the problem. Fine – no issues there (ideally yes, someone else checks the fix).

Then they find another screw that’s a bit loose – not that loose, really. They tighten it down. They begin to look at the cosmetic criteria – looks good.

Oops. That loose screw should have been recorded, right? Maybe that missing screw started out as loose (I blame the parents).

This happens more often when everyone is really friendly and there are penalties for failure. So, when Maria in inspection finds something Mary in assembly missed – Maria fixes it and nobody gets hurt. Except the reliability of the product and cost of assembly.

Either make sure nobody likes each other, or don’t attach a stigma to making mistakes (or mistake proof the process!). I’ll leave it up to you to choose.

7: Big Meetings Without Action Items

I’ll keep this one real short.

Don’t have a meeting without action items. A meeting without action items is called e-mail.

I said “Big” meetings; if two or three people need to exchange data verbally, fine. You define “big”.

Let me assert that Management Review meetings are big meetings. Please have action items.

If you have a meeting, and it turns into a status meeting – and everything looks good, then take the opportunity to change the definition of “good” to “great”.

Change the specification, or bring in the date – at least look at the feasibility of doing it better. If you feel like you’re already at “great” then re-allocate a resource, record some “lessons learned”.

Continual Improvement, my friend, generates Actions.

8th of 8 Mistakes: Taking Classes But Not Learning

Most courses and seminars are PowerPoint snooze-fests in over-air-conditioned rooms where you’re lucky to have a quiz at the end of four days. Just because the data is presented to you – doesn’t mean it has been taught to you, or that you have learned  it.

But yes, the lemon Danish was awesome and hey, you got a Certificate.

Certificates are nice, but skills and knowledge brought back to the work environment are like bars of gold-pressed latinum. Time and money are being spent- why not learn something?

Even if you’re a conscientious student executing the study habits that got you through high school or college – you could be retaining a whole lot more.

To most people, underlining and highlighting, rereading, cramming, and single-minded repetition are the extent of their learning repertoire. Recent studies have shown clearly that these skills create the illusion of mastery, and that any gains fade quickly.

Durable learning comes from things like:

  • self-testing,
  • introducing difficulties in practice,
  • waiting to re-study new material until a little forgetting has set in,
  • interleaving the practice of one skill or topic with another.

That’s basically the introductory paragraph of the book, Make It Stick: The Science of Successful Learning. I’ve read that book – it is an enlightening and inspiring read.

While there is a wealth of vital material on the internet, and within the corporate training rooms (and those freezing hotel conference rooms), most of it is simply that – material.

Learning is really your responsibility, you can’t rely on an instructor to do it for you.  Read. That. Book.

 

Thank you for listening, I hope you got something useful from the 8 common QMS Mistakes I see regularly. I’d love to hear back from you with something from your own list of painful things.

Sal

 

 

Imitation Game – Faking 9001

Faking 9001
Highest Form of Flattery

Faking 9001 or, “How to Fake a Management System”.

Yes, you read that right. I could say,”How to fool an ISO auditor”, or “How to pretend to have a management system” – but I think you get the idea.

I strive to disambiguate. I should also strive to speak more plainly. To you I present an introduction to my latest book. It is a work of comedic fiction (a flavor of fiction perpetuated solely in my own mind).

Ostensibly, it is a “How To” book. I’ve considered and rejected several titles with numbers. People like that kind of thing and I’ll put in more naming effort once I know what kinds of numbers are involved. Maybe, “9001 Ways to Fake It”.

I hope it isn’t more than seven.

In the real world, things happen; cogs turn and pistons pist. An auditor steps into the world for a day or three. She never sees the real world – she sees the manifestation of history in the forms of records, documents, an array of physical objects and people, and through discussion.

All of this is interpreted through a human brain riddled with genetic propensities toward cognitive bias. And a desire to get home.

Faking it well is helped by a solid understanding of the audit process.  That, and only slightly more than a vague familiarity with the standard.

Records

Quality records are the means by which an auditor sees much of the system. We put an inordinate amount of credibility in them, most of us.

So, there’s a minimum set we expect to see. The standard refers to them clearly.

From them we deduce the  existence of things in the past. Who knows if they’ve actually taken place.

  • Management Reviews
  • Internal Audits
  • Corrective Actions
  • Preventive Actions
  • Nonconforming material slips
  • Letters from customers; quotations
  • Purchase orders

There are more, the book has them. Actual management systems have them. Fake ones have them too.

But, a record is not an actual event. It is toner on paper. Or it consists of electrons bouncing on a liquid crystal display – all as real as crystal meth dreams behind blinking eyes.

Documents

Process and product documents sufficient to satisfy the sample size. Keep it simple; a few customers, a few simple designs.

Process documentation

A quality manual, six basic procedures, maybe a few more “tier twos” to make it look good. A work instruction or three.

Product documentation

Some drawings, product specifications, customer specifications. Cosmetic criteria…

Metrics

The coup de grâce. Charts, baby – charts. Bar charts, Pareto Charts and, the real killers – control charts.

See the previous posts about metrics – Customer satisfaction is vital. Get that – well, make that.

It’s got pretty colors and goal lines, right? Must be true. Don’t forget the goal lines.

Packaging it all

Binders – lots of binders. And logs, your going to need logs. And a few file folders. Just a few.

The idea is to provide easy access to the information in an organized appearing way. They are to be delivered to the auditor in a conference room. Stacks of binders.

Keep that person in the conference room for as long as possible. Time is your friend – use it up. Make sure there is a fridge in there, and snacks.

Maybe a nice mini-bar.

Records binder – this is where you’re going to assemble your management reviews and internal audit records. All of that stuff. Might need two of those.

Documents binder – Quality manual and the tier twos. Create a master list. Don’t make everything revision A. Higher revision levels indicate a more healthy system. Depending on your document control procedure you might need records to support the other revisions, like a DCN form – try not to over-complicate your life for no reason.

A file drawer of Purchase orders to vendors. Less vendors is going to be easier than more vendors. Have an approved vendors list. Don’t make it too hard to get on that list! Download ISO certs from those vendors you happen to have in the file drawer. Or a survey that they filled out (use a couple different colored pens at least) – do both, why not. Approve those P.O.’s!

A file drawer of completed sales orders. What should be in there? I don’t know… a quotation, a purchase order (with approvals from production saying it is possible to fulfill it), a job traveler with completed and signed-off steps, an inspection report, shipping documents. What? A letter from the customer saying how happy they were?? How did that get in there?

Throwing the Bones

Nobody is perfect. Don’t be a nobody; be a gambler – be someone that survives an audit. In this case, survival means getting a certificate on the wall.

A nonconformance isn’t going to keep you from it. You’re going to get one (technically you’ll be giving them) and then you’re going to analyze it, find the root cause of how it happened, you’re going to address that cause with some action to keep it from happening again, and finally, you’re going to verify that what you did, worked.

Try not to let anyone find all of that before the nonconformance is issued…

You’ll put all that into a package, send it to your Registrar, they will love it – and send you a Certificate.

What bones?

Minor bones, of course. Toss out Phalanx and phalanges – not femurs. Offer a femur and you’ll feel like you’re on the receiving end of “9001: A Space Odyssey”.

The auditor needs to feel like something was accomplished.

To an auditor, a nonconformance is like a souvenir ear they can bring back to their underground lair, “See, I was there…” he holds the trophy up for the other trolls to see by the light of their sooty fire – “And I got this!”

They grunt appreciatively and slap his hunched back, sharing in the victory.

Some examples:

  • A document in your document binder that has a revision that isn’t the same as what is in your master list (at the front of the document binder). Put two – no, three – maybe he’ll find one. But don’t put a rev 3 on a document and a rev 2 in the master list – that indicates a bigger problem and might earn you more digging and possibly a re-audit. You only want to put on one show.
  • A non-conformance that doesn’t have root cause filled out. Make it a simple one – something with an obvious cause. Two of these should do it.
  • Find an inspection record and re-copy it and in so doing obscure a diagonal half of it.
  • Assuming the impact is minimal, a piece of test equipment with a date that is unreadable. Don’t overdue that, it might earn a visual re-audit.
  • Also to avoid – unidentified items on your (hopefully very small) production floor. An accumulation of these will earn you a visual re-audit. Avoid anything that to verify that it is all fixed and fine would require someone to physically see the result in action.
  • Get creative. I am often surprised at peoples’ creativity.

What else?

Well, I haven’t really addressed how to stage a production area with it’s product and operators and all of it’s 7.5 implications. It is possible to do it. I can’t give away the whole show here!

Or interviews with the rank and file regarding the Quality Policy. Piece of cake.

Design. That seems tricky but it really isn’t.

Fooling one of us isn’t terribly hard – I wouldn’t be surprised if it happens quite often. But the point is, in the process of packaging and obfuscating one often implements the thing to good effect despite the frivolous ambition. It is neither the best nor the worst that is lost in the ambiguities of translation; truth is somewhere in the middle.

And isn’t it true that success is 80% perspiration and 20% making things up? I am pretty sure that’s how it goes.

Give it a shot. What could go wrong? Hrm – well, it might be against some law. Fraud maybe. I stayed in a Holiday Inn once… I’d ask your legal team about the idea first (then do it anyway, of course).

But if you pull it off, and it’s all in place – maintenance isn’t such a stretch, is it?? I mean, you went through all that trouble.

Next up: “How to fake Continual Improvement

😉

 

 

Quality Metrics Monday – June 2015

Quality Metrics
Quality metrics are a vital part of any management system. They allow for data-driven decision making. They allow the individuals within an organization to be able to answer the question, “How’s it going?” – without resorting to “gut feel”.

Gut feel is horribly unreliable, our brains lie to us (read the very good You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your Memory Is Mostly Fiction, and 46 Other Ways You’re Deluding Yourself, for examples).

I’ve covered quality metrics in earlier posts, particularly with regard to goals and objectives. That two-parter grew into some specific metrics for a Human Resources department and I’d like to add more departments as well.

Frankly, it got away form me a little. Hey, it happens… Let us begin again.

What are Quality Metrics?

Quality metrics, to summarize and perhaps pull a different tack, are the basis for continual improvement. Continual improvement is a large component of what compliance to the standard means. To use an oft quoted phrase, “If you don’t know where you are, a map won’t help. ” (attributed to software engineering legend Watts Humphrey).

  • Metrics let you know where you are – goals, objectives tell you where you want to be.
  • Metrics are measurable, and they are often numeric.
  • Metrics are sometimes called KPI’s (Key Process Indicators).
  • Metrics can be called Measurables (because they should be measurable).

The Minimum Set

When we audit, we’re looking for a minimal set of these measurables. I want to let you know that set, so your life – and mine, can be a little easier. And no, these aren’t set in stone, most of them aren’t anyway – but you should have something like these.

You should have something.

The other influence on the minimum set is going to be the Quality Policy of the company. Generally however, the most basic quality policy invokes the necessity for the metrics I will discuss below.

If your quality policy has something particular, like “… happy employees” then part of the set should have some way to measure that (Employee Turnover, for example). Or if the policy addresses “… a vital part of the community”, then your collection of metrics should include a measurement for that (participation in community outreach programs, perhaps).

To be fair, the standard is only specific about one metric, and metrics are only one  way to measure an objective. And where 9001 isn’t specific, it is so general that justifying the absence of a metric or the objective it measures get’s very… convoluted.

And this measuring of objectives is important because the gospel, according to 5.4.1, says that objectives shall be established at all relevant functions and levels within an organization. Here’s the chapter and verse:

5.4.1 Quality objectives
Top management shall ensure that quality objectives, including those needed to meet requirements for product…, are established at relevant functions and levels within the organization. The quality objectives shall be measurable and consistent with the quality policy.

Objectives shall be measurable… okay, I can play devil’s advocate too; “accomplished or not accomplished” – that’s a measurement.

Fine, that works – and sometimes it makes complete sense. But sometimes it is, at best, a short-cut, and as my dear-old-dad used to say, “You’re only hurting yourself”.

Metrics can heal. I said the standard only specifies one metric, so here it is:

8.2.1 Customer satisfaction
As one of the measurements of the performance of the quality management system, the organization shall monitor information relating to customer perception as to whether the organization has met customer requirements. The methods for obtaining and using this information shall be determined.

NOTE Monitoring customer perception can include obtaining input from sources such as customer satisfaction surveys, customer data on delivered product quality, user opinion surveys, lost business analysis, compliments, warranty claims and dealer reports.

So, an auditor wants to see that. What is your customers’ perception of how your company is meeting their requirements?

Not, “Our customers love us!” verbally expressed.

Not, “We hardly get any complaints.”

And no, not the blank deer-in-the-headlights stare followed up with, “So, would you like another doughnut?” (Yes. Yes, I would very much like another doughnut).

It can be a list of customers with a percentile score next to their name.

It can be a list of customers with a stoplight metric; green/yellow/red. Or little smiley faces. But behind the pretty lights and the unblinking eyes should be data.

How do you know? Like the notes says after the requirement in 9001:2008, “input from sources such as customer satisfaction surveys, customer data on delivered product quality, user opinion surveys, lost business analysis, compliments, warranty claims and dealer reports” – whatever your creative genius comes up with. But something.

I’ve seen Survey Monkey put to good use for this. Reply cards sent with the product generally have a horrible return rate and they are almost not worth the effort. On-line options tend to do better.

Have an overall score covering all customers, or individual scores – but be prepared to justify your choices. If you exclude some customers then explain why.

Action Plans to Meet Goals

Along with that metric there should be a Goal. And – this is important – if the goal is not being met then there should be an action plan to achieve the goal.

The requirement for this is manifold and at the core of the standard. Here’s one:

8.2.3 Monitoring and measurement of processes
The organization shall apply suitable methods for monitoring and, where applicable, measurement of the quality management system processes. These methods shall demonstrate the ability of the processes to achieve planned results. When planned results are not achieved, correction and corrective action shall be taken, as appropriate.

Here’s another:

8.5.1 Continual improvement
The organization shall continually improve the effectiveness of the quality management system through the use of the quality policy, quality objectives, audit results, analysis of data, corrective and preventive actions and management review.

One more:

8.4 Analysis of data
The organization shall determine, collect and analyse appropriate data to demonstrate the suitability and effectiveness of the quality management system and to evaluate where continual improvement of the effectiveness of the quality management system can be made. This shall include data generated as a result of monitoring and measurement and from other relevant sources.

I could go on…

Back to the Minimum Set

So, customer satisfaction is one. “Check.”

Here are some others we expect to see (depending on your business, of course).

On Time Delivery – I could be part of customer satisfaction. Have a way to measure it that is consistent.  Often MRP systems have a problem with making a sensible number out of the data it collects. There is absolutely no problem with normalizing the data afterwards. Do what you have to do to get a number that is consistent. It’s value is that it is a means toward continual improvement.

And, please, don’t tell me it is 100% unless you’re selling unrealistic expectations as an actual business. I will be happily surprised if you can achieve that goal – though yes, it does happen routinely for some companies. Make it a stretch goal, but start low and change it gradually as your process can consistently reach it.

Scrap – how much material are you not using. Some folks use this along side a “re-use” metric. This is typically a dollar value, but for some commodities it is a weight or volume metric to save frequent currency or value conversions.

Machine down-time – Can be tied with a “Preventive Maintenance tasks on time” report as they are often related.

The rest of the organization.

So far I’ve listed mostly production and operation-related metrics and those should be a “slam dunk” for most organizations.

The other departments, such as Sales, Purchasing, QA and HR have a typical set as well (covered HR pretty well in a  previous post).

Again, I am pointing out basic and typical minimum expected sets.

Sales

Conversion Rate – converting quotations into purchase orders

Time to quote – in days, usually.  Add your own fine print.

Purchasing

Time to place – Time between purchase request and placing of the order. This might include a sub-metric; Time to approve.

HR

I provide an extensive list here, but at a minimum, there should be a focus on the timing-related items, such as Time to Indoctrinate/Perform initial training.

QC

Hold times – inspection wait times, for example – we often find Cp, Cpk, etc. – but I think the product metrics are pretty well understood. I could cover them in another post.

QA

All of the the QMS related items, particularly:

Internal Audits on Time

Open NCR/CA/PA aging

Until Next Time

Please, don’t get the idea that all of these metrics are expected all of the time, other than customer satisfaction metrics.

But, most organizations could use a few more, rather than a few less. Certain metrics come and go. They get crushed, and another one takes its place.

At the end of the day they should provide value to the company, and generally that can’t be determined until they are tried on for a while.

Quality metrics are the lenses by which we see how the organization is working; make them work for you. Empty frames don’t do anyone any good.