This judges association needs to have event producer input, but be independent of event producer control. The panel judges group need to have autonomy, IMO, and be free from the gentle guiding hand of the Memphis Collective.
(If and only if Les were in charge, as he clearly should be, of a safety/legality group, then THAT could be USASF-controlled.)
I think realistically, EP's are going to have to input, and even a financial stake, in ensuring that a judges association gets off the ground. There needs to be an infrastructure in place for judges to be trained, certified, and reviewed. That costs money, and I don't think you can initially do that just by member dues. That doesn't mean necessarily you roll this into the USASF - although in a perfect world that is the place where this should be - but I think it's naive to think that EP's wouldn't have a role in this.
I think the judges association should cover the following key areas:
-Certification. Bottom line - anyone who wants to judge a USASF-sanctioned event must be certified. The requirements for certification increase as the level of competition you want to judge increases, which means you'll have levels of judges much like you have levels of soccer referees.
-Training. This involves not just in-person class training, but ongoing education and assessment. If you want to advance to higher level competitions, you not only need to take the appropriate classes, but there needs to be assessments done by your peers as well as highly-qualified judges who can review your work.
-Mechanics. One of the thing I learn as a referee is a fairly standard way to do things, whether it's signal for a foul, communicate with my center referee or even what I'm supposed to do in the pre-game. One of the key things I'd like to see is a judges association talk about how to standardize those things and then hold people to that standard - whether it be how you handle particular parts of the scoresheet, how you handle coach inquiries, or even how the simple mechanics of how you score a routine. It might silly to get to that level of detail, but officiating is a detail-oriented job.
The one thing that a judging body can't do is the thing that would make such an association most effective - enforce a single universal scoresheet and scoring rubric. Until you have that, there will be a pretty finite limit as to the effectiveness of such a panel.