COMPEL Certification Body of Knowledge — Module 4.5: Industry Standards Development and Methodology Advancement
Article 3 of 10
The EATP Lead's authority as a standards architect and methodology leader rests ultimately on evidence. Opinions, even expert opinions, carry limited weight in standards committees, peer-reviewed publications, and executive boardrooms. What carries weight is rigorous research — systematic investigation that produces verifiable findings, actionable insights, and defensible conclusions. This article equips the EATP Lead with the research design competencies needed to conduct original investigations that advance the field of AI transformation methodology.
Why Original Research Matters
The AI transformation field suffers from a research gap. Academic research tends to focus on AI technology — algorithms, models, architectures — rather than on AI transformation methodology — how organizations actually adopt, scale, and institutionalize AI. Consulting firms produce thought leadership, but it is typically marketing-driven and methodologically thin. The result is a field where practitioner knowledge is deep but poorly documented, and where decisions about methodology, governance, and organizational design are based more on anecdote than evidence.
The EATP Lead is uniquely positioned to close this gap. The EATP Lead has access to what academics often lack: real organizational transformation data, longitudinal observations of multi-year programs, and the practical understanding of what actually works versus what merely sounds compelling in a framework document. And the EATP Lead has what consulting firms often lack: the methodological rigor and intellectual honesty to design research that seeks truth rather than validates a predetermined narrative.
Research Design Fundamentals
The EATP Lead does not need to become a full-time academic researcher, but must understand the fundamentals of research design well enough to conduct credible investigations and to critically evaluate the research of others.
Research Questions
Every research project begins with a well-formed question. In AI transformation methodology, productive research questions typically fall into several categories:
Descriptive: What is the current state of practice? Example: "How do Fortune 500 organizations structure their AI governance functions?"
Comparative: How do different approaches compare? Example: "Do organizations with centralized AI CoEs achieve faster time-to-value than those with federated models?"
Causal: What causes what? Example: "Does executive AI literacy training reduce AI initiative failure rates?"
Evaluative: How effective is a specific practice? Example: "What is the measurable impact of COMPEL maturity assessments on organizational AI capability development?"
Design: What should be done? Example: "What operating model design maximizes cross-business-unit AI asset reuse?"
The strongest research questions are specific enough to be answerable, significant enough to matter, and novel enough to contribute knowledge that does not already exist.
Research Methodologies
The EATP Lead should be familiar with several research methodologies appropriate for AI transformation research:
Case Study Research: Deep investigation of a single organization or initiative to understand the dynamics of AI transformation in context. Case studies are particularly valuable for understanding complex, multi-variable phenomena — which describes most AI transformation programs. The EATP Lead can draw on their engagement experience to produce case studies that are both methodologically rigorous and practically relevant.
Survey Research: Structured data collection from a sample of organizations or practitioners to identify patterns, test hypotheses, and quantify prevalence of specific practices. Surveys provide breadth but sacrifice the depth of case studies. The EATP Lead can leverage professional networks to access survey populations that academic researchers may struggle to reach.
Comparative Analysis: Systematic comparison of organizations or initiatives that differ on specific variables of interest — maturity level, operating model design, governance structure — to identify patterns and correlations. This approach is particularly relevant for evaluating alternative approaches to common AI transformation challenges.
Action Research: Research conducted within a live transformation engagement, where the researcher is also a participant. Action research is well-suited to the EATP Lead role because it integrates rigorous observation with practical contribution. However, it requires careful management of the dual role — researcher and practitioner — to maintain objectivity.
Longitudinal Studies: Research that tracks organizations or initiatives over extended periods to observe how AI capability develops, operating models evolve, and transformation outcomes unfold. Longitudinal studies are rare and extremely valuable because AI transformation is a multi-year process whose outcomes cannot be assessed through point-in-time measurement.
Mixed Methods: Combining quantitative data (surveys, metrics, performance data) with qualitative data (interviews, observations, document analysis) to develop both statistical patterns and rich understanding of underlying dynamics. Mixed methods research is particularly appropriate for AI transformation, where both measurable outcomes and contextual factors matter.
Research Quality Criteria
The EATP Lead should apply and evaluate research against established quality criteria:
Validity: Does the research measure what it claims to measure? Are the findings accurate representations of the phenomena being studied?
Reliability: Would the same research design, applied in the same context, produce the same findings? Are the methods consistent and reproducible?
Generalizability: To what extent can findings from a specific study be applied to other contexts? What are the boundary conditions?
Rigor: Are the methods appropriate for the research question? Is the analysis thorough? Are alternative explanations considered?
Relevance: Does the research address questions that matter to practitioners and the field? Will the findings change how organizations approach AI transformation?
Designing a Research Program
The EATP Lead should approach research systematically, developing a multi-year research program rather than conducting isolated studies:
Step 1: Research Agenda Development
Identify the 3-5 research themes that the EATP Lead will pursue over a multi-year horizon. These themes should align with:
- Gaps in the AI transformation knowledge base
- The EATP Lead's areas of deepest expertise and access
- Standards development needs (research that directly informs standards is particularly impactful)
- Emerging challenges in AI transformation practice
Step 2: Data Asset Inventory
Identify the data assets the EATP Lead has access to that could support research:
- Maturity assessment data from COMPEL engagements (appropriately anonymized)
- Transformation program performance data
- Stakeholder interview transcripts and survey responses
- Organizational documentation and artifacts
- Professional network connections who could serve as research participants
Step 3: Research Project Design
For each research project, develop a research design document that specifies:
| Element | Description |
|---|---|
| Research question | Specific, answerable question |
| Literature review | What existing research addresses this question? |
| Methodology | How will data be collected and analyzed? |
| Sample/scope | Which organizations, practitioners, or initiatives will be studied? |
| Data collection | What specific data will be collected and how? |
| Analysis approach | How will data be analyzed to answer the question? |
| Ethical considerations | How will participant confidentiality, data privacy, and informed consent be managed? |
| Timeline | When will each phase be completed? |
| Output | What form will the findings take — paper, report, presentation? |
Step 4: Ethical Research Practice
AI transformation research involves organizational data that may be commercially sensitive, personally identifiable, or otherwise requiring careful handling. The EATP Lead must:
- Obtain informed consent from research participants and organizations
- Anonymize data to prevent identification of organizations and individuals
- Protect data against unauthorized access
- Disclose any conflicts of interest (e.g., conducting research on a methodology the EATP Lead commercially promotes)
- Submit research involving human subjects to appropriate ethical review where required
From Research to Impact
Research has impact only when it reaches and influences its intended audience. The EATP Lead should plan for impact from the beginning of the research design process:
Practitioner Impact
- Translate findings into actionable guidance that practitioners can apply in their engagements
- Present findings at practitioner conferences and in practitioner-oriented publications
- Incorporate findings into COMPEL training materials and methodology updates
Standards Impact
- Frame findings in terms relevant to specific standards initiatives
- Submit findings as evidence during standards comment periods
- Present findings at standards committee meetings
Academic Impact
- Submit findings to peer-reviewed journals for publication (discussed in Article 4)
- Present at academic conferences to reach the research community
- Collaborate with academic researchers to extend and validate findings
Policy Impact
- Frame findings in terms relevant to regulatory and policy discussions
- Submit findings during regulatory consultation and comment periods
- Present findings to policy-maker audiences
Building Research Capability
The EATP Lead may not begin with strong research design skills. Building this capability requires investment:
- Formal Training: Graduate-level research methods courses, either through academic programs or professional development offerings
- Mentorship: Relationships with experienced researchers — academic faculty, research-oriented consultants, or senior professionals with research backgrounds
- Collaboration: Joint research projects with academic partners, who contribute methodological rigor while the EATP Lead contributes practitioner access and domain expertise
- Practice: Research capability develops through practice. The EATP Lead should begin with smaller, more contained research projects and build toward larger, more complex investigations
Looking Ahead
The next article, Module 4.5, Article 4: Publishing and Peer Contribution in AI Governance, addresses how the EATP Lead communicates research findings and methodology insights through publication — peer-reviewed journals, professional publications, and industry outlets. Publication is the mechanism through which research becomes knowledge and through which the EATP Lead establishes thought leadership credibility.
© FlowRidge.io — COMPEL AI Transformation Methodology. All rights reserved.