Loading...

An Approach to Choose the Maturity Model and DevOps Tools based on the Capabilities, Practices and Expected Outcomes of the Organization

Azizi Khadem, Ehsan | 2026

27 Viewed
  1. Type of Document: Ph.D. Dissertation
  2. Language: Farsi
  3. Document No: 58811 (19)
  4. University: Sharif University of Technology
  5. Department: Computer Engineering
  6. Advisor(s): Movaghar, Ali
  7. Abstract:
  8. This research presents an integrated approach for the joint selection of DevOps maturity models, capabilities, practices and tools based on organizational outcomes. The study begins with a systematic and multivocal literature review, through which key concepts and their relationships are extracted and normalized, enabling the construction of mapping in the form of outcome → capability → practice → tool. A scoring and prioritization mechanism is then designed, incorporating semantic relevance, textual evidence, co-occurrence patterns and structural constraints. The approach further leverages retrieval-augmented generation to rank alternative transformation pathways aligned with organizational goals. A prototype system is implemented and evaluated in three stages: (1) response quality assessment using outcome-oriented queries, (2) expert evaluation to assess usefulness and actionability of recommendations and (3) robustness analysis under data variation and noise. In addition, a real-world case study is conducted in a software service organization with over one million users, where the recommended interventions are deployed over a defined period. The results demonstrate that the proposed approach produces transparent, traceable and evidence-based recommendations, outperforming baseline methods in accuracy and effectiveness. In the case study, significant improvements are observed across key performance indicators, including an increase in deployment frequency (up to 45%), a reduction in mean time to recovery (over 80%) and a decrease in change lead time (approximately 70%). Expert assessments further confirm the high usefulness and actionability of the recommended pathways. The proposed approach can serve as a decision-support system for DevOps transformation planning, tool portfolio management and progress evaluation
  9. Keywords:
  10. Maturity Level Model ; Retrieval-Augmented Generation ; Required ; Organizational Outcomes ; Tool Selection ; Practices

 Digital Object List

 Bookmark

No TOC