My point is - and has always been - that no test inside the school is what I'd consider full verification of physical self-defense. The program you mentioned isn't physical self-defense (and can be executed on larger scale), so can be measured with real-world statistics. That's how it's done with corporate training (your comparison). Let's get something comparable to physical SD testing from the corporate world: policies regarding how to respond to bank robbery. There are some basic tenets that every bank follows. They seem to be effective at keeping people from getting hurt, limiting loss, and helping capture robbers. I say "seem to be", because there simply aren't many bank robberies to test them with. These are not ever going to be validated with the same kinds of statistics as the program you mentioned, nor the kinds of measurements that could be put around, for instance, training tellers to count money in a specific way to prevent cash errors.It is possible to approach self defense in a scientifically sound way. It's just like corporate training. You identify a specific need, along with a set of measurable, specific outcomes/objectives, create a training plan designed to improve the measurables, and then actually follow through by evaluating the success of the program. A group addressing sexual assault in college campuses put together a program that, in six weeks, had a measurable, positive affect. Interestingly enough, the portion of training most often central to self defense training (physical self defense techniques) was a minor element of the program.
Otherwise, it's all intuition and wishful thinking. Gpseymour, you more than anyone should know this is true.
So, if you're asking me what I would consider a valid test of self defense, I'd start by asking you to define some actual objectives or measurable goals of your training. A valid test of your specific self defense training would depend entirely upon the answer.
Absent this, you are hoping for the best. Earlier, yiu asked how a sport art could prepare someone less for self defense than a non sport art which purports to emphasize self defense. I think there is integrity in a system that tests what it teaches. In a sport, one learns to perform skills in a context, and the test is consistent with the objectives. in a style that does eschews sport, the test bears little resemblance to the purported goals of the training. I have heard that a karate test is a grueling affair, which combines execution of kata, some sparring, perhaps some Oral or written component. But as you say, you can't test self defense. So, there is an inherent disconnect... A fundamental lack of structural integrity.
This isn't to say that the skills are useless. Rather, it means that there is a perfect environment for confirmation bias. Self defense is not defined, so it can literally mean anything. Which also means that I can measure the success of my training any way I wish, and excuse the failures in the same way.
AndBill'scomment about kata and the thrust kick is a perfect example of self defense training that doesn't correlate to self defense.
I'll add just that you mention how you identify the techniques yiu choose to teach, which is great. But that's only half the story. You also have to ensure thateach individual can execute these techniques in some measurable context which is consistent with the desired outcome. Or simply put, I know some techniques work because I see others execute them.
The same issue exists with physical self-defense training. If I have 100 students, chances are almost none of them will be in a physical altercation in a given year. Let's say 10 get in a "situation", and 8 de-escalate it, and 2 have to do something physical. That's too small a sample for any validity from a statistical perspective. I could pull apart what happened in each one if I have video (people's memories are simply to plastic to use for this), but each attack is so unique, I can't really draw any conclusions other than whether a specific technique that was used did or did not work in that isolated situation. The variables are too many to be able to draw many conclusions from either failure or success (skill and size of the attacker, element of surprise, fear/anger, ground, limited space, people nearby or not, skill and size of the defender, etc.).
So, what do we do? We test in the school. I can't call it valid testing on the order one can do with training for competition, but it's the best anyone can really manage. We simulate attacks we, individually, wouldn't choose. We test against common (and some uncommon) attacks, with different levels of commitment and skill. We spar, to test against someone who knows what they're doing. But none of that can accurately replicate the situation of an actual attack in the street.