<?xml version="1.0" encoding="UTF-8"?><!-- generator="wordpress/2.3.3" -->
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	>
<channel>
	<title>Comments on: Could the Military Be Waking Up?</title>
	<link>http://www.satisfice.com/blog/archives/68</link>
	<description>The Consulting Software Tester</description>
	<pubDate>Sat, 22 Nov 2008 08:28:36 +0000</pubDate>
	<generator>http://wordpress.org/?v=2.3.3</generator>
		<item>
		<title>By: Erwin Van Trier</title>
		<link>http://www.satisfice.com/blog/archives/68#comment-6774</link>
		<dc:creator>Erwin Van Trier</dc:creator>
		<pubDate>Fri, 20 Oct 2006 14:42:34 +0000</pubDate>
		<guid>http://www.satisfice.com/blog/archives/68#comment-6774</guid>
		<description>The department of Defense also seems to have a study (I am trying to get a link to that report) that concludes that the waterfall method in as a SW development methdology had 0 (zero!) efficiency for their projects.

I might be making too many assumptions now, but I always thought  that the Capability Maturity Model (CMM) was originally created by/for the Department of Defense. It seems that they never used the model to come to the conclusions they are making now.

On a seperate note, the FDA seems to start asking some questions. During one of the conferences with FDA participation, attended by my peers, the FDA people indicated that they wonder why medical devices have so many problems.
My answer to the FDA would be that their own guidance would be a direct cause of the issue the are investigating. As far as I know the FDA guidance does not address skill nor training. I believe that both elements should be a key for any guidance document.

During that same conference FDA also revealed the issue about document approvals
There seems to be a systemic problem of too many reviewers and approvers on documentation, and that too many lessens the constructive criticism from the review process.  An informal study by an FDA inspector inferred that the quality of a document was inversely proportional to the number of signatures when that number was greater then three.

&lt;em&gt;[James' Reply: The SEI, which created the CMM, was funded by the Department of Defense for years. I don't know whether they still are. The great traction that the CMM received has nothing to do with its merit. Adoption of it is limited almost exclusively to companies who gain a specific marketing benefit from it, or who seek preferred treatment on military contracts, which lamely require CMM "maturity".&lt;/em&gt;

&lt;em&gt;I have seen people who seem to have fire in their eyes about the CMM despite no obvious economic benefit to themselves due to CMM PR, but they are few and far between.]&lt;/em&gt;</description>
		<content:encoded><![CDATA[<p>The department of Defense also seems to have a study (I am trying to get a link to that report) that concludes that the waterfall method in as a SW development methdology had 0 (zero!) efficiency for their projects.</p>
<p>I might be making too many assumptions now, but I always thought  that the Capability Maturity Model (CMM) was originally created by/for the Department of Defense. It seems that they never used the model to come to the conclusions they are making now.</p>
<p>On a seperate note, the FDA seems to start asking some questions. During one of the conferences with FDA participation, attended by my peers, the FDA people indicated that they wonder why medical devices have so many problems.<br />
My answer to the FDA would be that their own guidance would be a direct cause of the issue the are investigating. As far as I know the FDA guidance does not address skill nor training. I believe that both elements should be a key for any guidance document.</p>
<p>During that same conference FDA also revealed the issue about document approvals<br />
There seems to be a systemic problem of too many reviewers and approvers on documentation, and that too many lessens the constructive criticism from the review process.  An informal study by an FDA inspector inferred that the quality of a document was inversely proportional to the number of signatures when that number was greater then three.</p>
<p><em>[James&#8217; Reply: The SEI, which created the CMM, was funded by the Department of Defense for years. I don&#8217;t know whether they still are. The great traction that the CMM received has nothing to do with its merit. Adoption of it is limited almost exclusively to companies who gain a specific marketing benefit from it, or who seek preferred treatment on military contracts, which lamely require CMM &#8220;maturity&#8221;.</em></p>
<p><em>I have seen people who seem to have fire in their eyes about the CMM despite no obvious economic benefit to themselves due to CMM PR, but they are few and far between.]</em></p>
]]></content:encoded>
	</item>
	<item>
		<title>By: insectivorous</title>
		<link>http://www.satisfice.com/blog/archives/68#comment-6293</link>
		<dc:creator>insectivorous</dc:creator>
		<pubDate>Tue, 17 Oct 2006 21:48:25 +0000</pubDate>
		<guid>http://www.satisfice.com/blog/archives/68#comment-6293</guid>
		<description>The problem seems to be growing, and not correcting, at least insofar as the civilian government goes. I'm not sure who started it, but the FAA gets the blame for the system that was going to redefine civil air traffic control in the US, and instead redefined the actual worth of the CMM as per James' article. Then it spread to the Department of Justice, who used standards and paperwork  to create the FBI's new case file management system. It's quite rare to do that, to be able to produce a system which, years later, contains absolutely nothing of any use at all.  It has spread to the Department of Energy, and should preclude any useful automation happening there. But I'm sure it will all meet the latest government standards as it fails, runs over budget and over schedule.</description>
		<content:encoded><![CDATA[<p>The problem seems to be growing, and not correcting, at least insofar as the civilian government goes. I&#8217;m not sure who started it, but the FAA gets the blame for the system that was going to redefine civil air traffic control in the US, and instead redefined the actual worth of the CMM as per James&#8217; article. Then it spread to the Department of Justice, who used standards and paperwork  to create the FBI&#8217;s new case file management system. It&#8217;s quite rare to do that, to be able to produce a system which, years later, contains absolutely nothing of any use at all.  It has spread to the Department of Energy, and should preclude any useful automation happening there. But I&#8217;m sure it will all meet the latest government standards as it fails, runs over budget and over schedule.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Mike Doel</title>
		<link>http://www.satisfice.com/blog/archives/68#comment-4976</link>
		<dc:creator>Mike Doel</dc:creator>
		<pubDate>Tue, 10 Oct 2006 15:05:13 +0000</pubDate>
		<guid>http://www.satisfice.com/blog/archives/68#comment-4976</guid>
		<description>James,

It was with great interest I read your experiences of the military plannng process.  It seems to me that whenever you get involved with large governent based institutions, (such as the NHS - National Health Service in the UK) that you are often faced with  reams of beurocratic process and adherence to convoluted, overly complex and out of date procedures no matter how insane. (I wonder when "Mil-std-499" was written.) This in some sense counterpoints my experiences with most commercial businesses who seem to have problems enforcing an adhereing to good practice and process. Maybe its because these processes have been given to them rather than developed and matured from within.

What do you think, any ideas on why we seem have such extremes of bad practice.

Perhaps the process of change for government institutions is just much slower than a commercially driven business.  Perhaps the commercail world has been driven to run before it can walk ,where as the other doesnt want to walk unless it has too.

Leading on from that, does rigoursly applied process narrow the mind and just give people an excuse for not thinking outside the box.

Mike Doel

&lt;em&gt;[James' Reply: Any sufficiently large institution, like a sufficiently large landform, creates its own weather. People working in very large organizations, especially if there is little turnover, tend to see their own experiences as defining the very limits of the world. Add money and ambition to this equation, and process work becomes something akin to a medieval landscape. Fiefdoms are established. Feudal lords reign. Learning, innovation, and high achievement take a back seat to bombast and ritual.&lt;/em&gt;

&lt;em&gt;To counteract this effect takes a strong personality-- someone like Kelly Johnson, who created Lockheed's Skunkworks in order to escape the stultifying organization that would otherwise have prevented his crew from creating such masterpieces as the U2, the SR-71, and the stealth fighter.]&lt;/em&gt;</description>
		<content:encoded><![CDATA[<p>James,</p>
<p>It was with great interest I read your experiences of the military plannng process.  It seems to me that whenever you get involved with large governent based institutions, (such as the NHS - National Health Service in the UK) that you are often faced with  reams of beurocratic process and adherence to convoluted, overly complex and out of date procedures no matter how insane. (I wonder when &#8220;Mil-std-499&#8243; was written.) This in some sense counterpoints my experiences with most commercial businesses who seem to have problems enforcing an adhereing to good practice and process. Maybe its because these processes have been given to them rather than developed and matured from within.</p>
<p>What do you think, any ideas on why we seem have such extremes of bad practice.</p>
<p>Perhaps the process of change for government institutions is just much slower than a commercially driven business.  Perhaps the commercail world has been driven to run before it can walk ,where as the other doesnt want to walk unless it has too.</p>
<p>Leading on from that, does rigoursly applied process narrow the mind and just give people an excuse for not thinking outside the box.</p>
<p>Mike Doel</p>
<p><em>[James&#8217; Reply: Any sufficiently large institution, like a sufficiently large landform, creates its own weather. People working in very large organizations, especially if there is little turnover, tend to see their own experiences as defining the very limits of the world. Add money and ambition to this equation, and process work becomes something akin to a medieval landscape. Fiefdoms are established. Feudal lords reign. Learning, innovation, and high achievement take a back seat to bombast and ritual.</em></p>
<p><em>To counteract this effect takes a strong personality&#8211; someone like Kelly Johnson, who created Lockheed&#8217;s Skunkworks in order to escape the stultifying organization that would otherwise have prevented his crew from creating such masterpieces as the U2, the SR-71, and the stealth fighter.]</em></p>
]]></content:encoded>
	</item>
</channel>
</rss>
