International Journal of Reliability, Risk and Safety: Theory and Application

International Journal of Reliability, Risk and Safety: Theory and Application

Considering Testing Environment Uncertainty in an NHPP Model with Exponentiated Weibull TEF

Document Type : Original Research Article

Authors
Javaid Iqbal 1
Nyla Manzoor 1
Refath Farooq 1
Tariq Rasool 2
Rabia Nazir 1
1 Department of Computer Science, School of Applied Sciences and Technology, University of Kashmir, Srinagar, India
2 University Institute of Computing, Chandigarh University, Punjab, India
10.22034/IJRRS.2025.8.1.6
Abstract
This study presents an approach to software reliability estimation by incorporating an Exponentiated Weibull Testing Effort Function into a Logistic Software Reliability Growth Model (SRGM) under the influence of uncertain factors. These uncertainty factors account for the variability and imprecision present in the software-testing environment, which often arise from assumptions and parameter estimations. The proposed model’s practical applicability is illustrated using a real-world software failure dataset. To evaluate its performance, comparisons are made with several well-established SRGMs using three standard evaluation criteria. The results indicate that the proposed model offers improved reliability estimation accuracy and outperforms selected existing models by obtaining the highest R2 value and the lowest MSE and SSE values.
Keywords
Logistic model
Project management
Software reliability
Software reliability Growth Model (SRGM)
Software testing
Testing effort
Exponentiated Weibull
Subjects
  1. Iqbal, N. Ahmad, and S. M. K. Quadri, "A software reliability growth model with two types of learning," in International Conference on Machine Intelligence and Research Advancement, Katra, India, 2013, pp. 498–503, https://doi.org/10.1109/ICMIRA.2013.105
  2. Iqbal, N. Ahmad, and S. M. K. Quadri, "A software reliability growth model with two types of learning and a negligence factor," in IEEE Second International Conference on Image Information Processing, Shimla, India, 2013, pp. 678–683, https://doi.org/10.1109/ICIIP.2013.6707680
  3. Iqbal, S. M. K. Quadri, and N. Ahmad, "An imperfect-debugging model with learning-factor based fault-detection rate," in International Conference on Computing for Sustainable Global Development, New Delhi, India, 2014, pp. 383–387, https://doi.org/10.1109/IndiaCom.2014.6828164
  4. Iqbal, "Software reliability growth models: A comparison of linear and exponential fault content functions for study of imperfect debugging situations," Cogent Engineering, vol. 4, no. 1, p. 1286739, 2017, https://doi.org/10.1080/23311916.2017.1286739
  5. Khurshid, A. K. Shrivastava, and J. Iqbal, "Fault prediction modelling in open source software under imperfect debugging and change-point," International Journal of Open Source Software and Processes, vol. 9, no. 2, pp. 1–17, 2018. https://doi.org/10.4018/IJOSSP.2018040101
  6. Saraf and J. Iqbal, "Generalized multi‐release modelling of software reliability growth models from the perspective of two types of imperfect debugging and change point," Quality and Reliability Engineering International, vol. 35, no. 7, pp. 2358–2370, 2019, https://doi.org/10.1002/qre.2516
  7. Saraf and J. Iqbal, "Generalized software fault detection and correction modeling framework through imperfect debugging, error generation and change point," International Journal of Information Technology, vol. 11, no. 4, pp. 751–757, 2019. https://doi.org/10.1007/s41870-019-00321-x
  8. Khurshid, A. K. Shrivastava, and J. Iqbal, "Generalized multi-release framework for fault prediction in open source software," International Journal of Software Innovation, vol. 7, no. 4, pp. 86–107, 2019, https://doi.org/10.4018/IJSI.2019100105
  9. Saraf, A. K. Shrivastava, and J. Iqbal, "Generalised fault detection and correction modelling framework for multi-release of software," International Journal of Industrial and Systems Engineering, vol. 34, no. 4, pp. 464–493, 2020, https://doi.org/10.1504/IJISE.2020.106085
  10. Saraf, J. Iqbal, A. K. Shrivastava, and S. Khurshid, "Modelling reliability growth for multi‐version open source software considering varied testing and debugging factors," Quality and Reliability Engineering International, vol. 38, no. 4, pp. 1814–1825, 2022, https://doi.org/10.1002/qre.3048
  11. Khurshid, A. K. Shrivastava, and J. Iqbal, "Generalised multi release framework for fault determination with fault reduction factor," International Journal of Information and Computer Security, vol. 17, no. 1–2, pp. 164–178, 2022, https://doi.org/10.1504/IJICS.2022.121296
  12. Khurshid, J. Iqbal, I. A. Malik, and B. Yousuf, "Modelling of NHPP based software reliability growth model from the perspective of testing coverage, error propagation and fault withdrawal efficiency," International Journal of Reliability, Quality and Safety Engineering, vol. 29, no. 4, Art. no. 2250013, 2022, https://doi.org/10.1142/S0218539322500139
  13. Iqbal, T. Firdous, A. K. Shrivastava, and I. Saraf, "Modelling and predicting software vulnerabilities using a sigmoid function," International Journal of Information Technology, vol. 14, no. 2, pp. 649–655, 2022, https://doi.org/10.1007/s41870-021-00844-2
  14. L. Goel and K. Okumoto, "Time-dependent error-detection rate model for software reliability and other performance measures," IEEE Transactions on Reliability, vol. R-28, no. 3, pp. 206–211, Aug. 1979, https://doi.org/10.1109/TR.1979.5220566
  15. Ohba and X. M. Chou, "Does imperfect debugging affect software reliability growth?," in 11th international conference on Software engineering, Pittsburgh, USA, 1989, pp. 237–244. https://doi.org/10.1145/74587.74619
  16. Ohba, "Software reliability analysis models," IBM Journal of Research and Development, vol. 28, no. 4, pp. 428–443, 1984. https://doi.org/10.1147/rd.284.0428
  17. Pradhan, A. Kumar, and J. Dhar, "Emerging trends and future directions in software reliability growth modeling," in Engineering Reliability and Risk Assessment, H. Garg and M. Ram, Eds. Elsevier, 2023, pp. 131–144, https://doi.org/10.1016/B978-0-323-91943-2.00011-3
  18. K. Kapur, H. Pham, S. Anand, and K. Yadav, "A unified approach for developing software reliability growth models in the presence of imperfect debugging and error generation," IEEE Transactions on Reliability, vol. 60, no. 1, pp. 331–340, 2011, https://doi.org/10.1109/TR.2010.2103590
  19. Y. Huang and S. Y. Kuo, "Analysis of incorporating logistic testing-effort function into software reliability modeling," IEEE Transactions on Reliability, vol. 51, no. 3, pp. 261–270, 2002, https://doi.org/10.1109/TR.2002.801847
  20. Pham, "A generalized logistic software reliability growth model," Opsearch, vol. 42, no. 4, pp. 322–331, 2005,  https://doi.org/10.1007/BF03398744
  21. U. Bokhari and N. Ahmad, "Software reliability growth modeling for exponentiated weibull function with actual software failures data," Innovative Applications of Information Technology for the Developing World, pp. 390-395, 2007, https://doi.org/10.1142/9781860948534_0062
  22. Ahmad, M. U. Bokhari, S. M. K. Quadri, and M. G. M. Khan, "The exponentiated Weibull software reliability growth model with various testing-efforts and optimal release policy: A performance analysis," International Journal of Quality and Reliability Management, vol. 25, no. 2, pp. 211–235, 2008, https://doi.org/10.1108/02656710810846952
  23. Ahmad, M. G. M. Khan, and L. S. Rafi, "A study of testing-effort dependent inflection S-shaped software reliability growth models with imperfect debugging," International Journal of Quality and Reliability Management, vol. 27, no. 1, pp. 89–110, 2010, https://doi.org/10.1108/02656711011009335
  24. Ahmad, M. G. M. Khan, S. M. K. Quadri, and M. Kumar, "Modelling and analysis of software reliability with Burr type X testing-effort and release-time determination," Journal of Modelling in Managemen, vol. 4, no. 1, pp. 28–54, 2009, https://doi.org/10.1108/17465660910943748
  25. Ahmad, M. G. M. Khan, and L. S. Rafi, "Software reliability modeling incorporating log‐logistic testing‐effort with imperfect debugging," AIP Conference Proceedings, vol. 1298, no. 1, pp. 651-657, 2010, https://doi.org/10.1063/1.3516395
  26. Ahmad and M. Z. Imam, "Software reliability growth models with Log‑logistic testing‑effort function: A comparative study," International Journal of Computer Applications, vol. 75, no. 12, pp. 6–11, Aug. 2013, https://doi.org/10.5120/13161-0818
  27. Khurshid, A. K. Shrivastava, and J. Iqbal, "Effort-based software reliability model with fault reduction factor, change point and imperfect debugging," International Journal of Information Technology, vol. 13, no. 1, pp. 331–340, 2021, https://doi.org/10.1007/s41870-019-00286-x
  28. Saraf, A. K. Shrivastava, and J. Iqbal, "Effort-based fault detection and correction modelling for multi release of software," Int. J. Inf. Comput. Secur., vol. 14, no. 3–4, pp. 354–379, 2021. https://doi.org/10.1504/IJICS.2021.114711
  29. Jain, P. Agarwal, and R. Solanki, "NHPP-Based SRGM Using Time-Dependent Fault Reduction Factors (FRF) and Gompertz TEF," in Decision Analytics Applications in Industry, P. K. Kapur, G. Singh, Y. S. Klochkov, and U. Kumar Eds. Singapore: Springer Nature Singapore, 2020, pp. 81-89, https://doi.org/10.1007/978-981-15-3643-4_6
  30. Rafi and S. Akthar, "Software reliability growth model with Gompertz TEF and optimal release time determination by improving the test efficiency," International Journal of Computer Applications, vol. 7, no. 11, pp. 34–43, 2010, https://doi.org/10.5120/1337-1741
  31. Iqbal, N. Manzoor, and R. Farooq, "Study and analysis of testing effort functions for software reliability modeling," in System Reliability and Security, pp. 143–163, Auerbach Publications, 2023, https://doi.org/10.1201/9781032624983-8
  32. Pradhan, J. Dhar, and A. Kumar, "Testing-effort based NHPP software reliability growth model with change-point approach," Journal of Information Science and Engineering, vol. 38, no. 2, 2022, pp. 343-355, https://doi.org/10.6688/JISE.202203_38(2).0004
  33. Iqbal, R. Nazir, and T. Rasool, "NHPP based testing coverage model with fault removal efficiency and error generation," International Journal of Reliability, Quality and Safety Engineering, vol. 32, no. 1, 2024, 2025, Art. no. 2450046, https://doi.org/10.1142/S0218539324500463
  34. Iqbal, N. Manzoor, A. K. Shrivastava, and I. A. Malik, "Integrating Burr type testing effort functions in logistic reliability growth model with uncertainty factor," International Journal of System Assurance Engineering and Management, vol. 14, no. 6, pp. 2365–2375, 2023, https://doi.org/10.1007/s13198-023-02084-y
  35. A. Haque and N. Ahmad, "Software reliability modeling under an uncertain testing environment," International Journal of Modelling and Simulation, vol. 45, no. 1, pp. 321-327, 2023, https://doi.org/10.1080/02286203.2023.2201905
  36. Li, T. Dohi, and H. Okamura, "Are infinite-failure NHPP-based software reliability models useful?," Software, vol. 2, no. 1, pp. 1–18, 2022. https://doi.org/10.3390/software2010001
  37. K. Behera and P. Agarwal, "Effect of weibull TEF on SRGM subject to field environment," International Journal of Reliability, Quality and Safety Engineering, vol. 32, no. 03, 2024, Art. no. 2450054, https://doi.org/10.1142/S0218539324500542
  38. K. Behera and P. Agarwal, "Modeling software reliability with power law testing effort function under operational uncertain environment," Journal of Software: Evolution and Process, vol. 37, no. 7, 2025, Art. no. e70037, https://doi.org/10.1002/smr.70037
  39. Pham, "A generalized fault-detection software reliability model subject to random operating environments," Vietnam Journal of Computer Science, vol. 3, no. 3, pp. 145–150, 2016, https://doi.org/10.1007/s40595-016-0065-1
  40. M. U. Din, J. Iqbal, and S. Qureshi, "Software reliability prediction using neural networks: A non-parametric approach," in System Reliability and Security, pp. 14–27, Auerbach Publications. https://doi.org/10.1201/9781032624983-1
  41. M. U. Din, S. Qureshi, and J. Iqbal, "GNN approach for software reliability," in System Reliability and Security, Javaid Iqbal et al. Eds. New York: Auerbach Publications, 2023, http://dx.doi.org/10.1201/9781032624983-1
  42. Iqbal, F. S. Masoodi, I. A. Malik, S. Khurshid, I. Saraf, and A. M. Bamhdi, Eds., System Reliability and Security: Techniques and Methodologies. New York: CRC Press, 2023. https://doi.org/10.1201/9781032624983
  43. N., A. Mahapatra, and G. S. Mahapatra, "Predictive framework of software reliability analysis under multiple change points and imperfect debugging," Software Quality Journal, vol. 33, 2025, Art. no. 21, https://doi.org/10.1007/s11219-025-09718-3
  44. Roy, G. S. Mahapatra, and K. N. Dey, "An NHPP software reliability growth model with imperfect debugging and error generation," International Journal of Reliability, Quality and Safety Engineering, vol. 21, no. 2, 2014, Art. no. 1450008, https://doi.org/10.1142/S0218539314500089
  45. Roy and H. Pham, "Toward the development of a conventional time series based web error forecasting framework," Empirical Software Engineering, vol. 23, no. 2, pp. 570–644, 2018, https://doi.org/10.1007/s10664-017-9530-4
  46. Nazir, J. Iqbal, F. S. Masoodi, and A. K. Shrivastava, "Developing an innovative imperfect debugging software reliability growth model with enhanced testing coverage strategies," International Journal of Reliability, Quality and Safety Engineering, vol. 31, no. 5, 2024, Art. no. 2450017, https://doi.org/10.1142/S0218539324500177
  47. A. Haque and N. Ahmad, "A logistic growth model for software reliability estimation considering uncertain factors," International Journal of Reliability, Quality and Safety Engineering, vol. 28, no. 5, Art. no. 2150032, 2021, https://doi.org/10.1142/S0218539321500327
  48. Z. Ahmad and N. Ahmad, "Parametric software reliability growth model with testing effort: A review," in International Conference on Computational Performance Evaluation, Shillong, India, 2021, pp. 899–904, https://doi.org/10.1109/ComPE53109.2021.9752232
  49. Hossain and R. Dahiya, "Estimating the parameters of a non-homogeneous Poisson-process model for software reliability," IEEE Transactions on Reliability, vol. 42, no. 4, 1994. https://doi.org/10.1109/24.273589
  50. Yamada, M. Ohba, and S. Osaki, "S-shaped reliability growth modeling for software error detection," IEEE Transactions on Reliability, vol. 32, no. 5, 1983, https://doi.org/10.1109/TR.1984.5221826
  51. Yamada, K. Tokuno, and S. Osaki, "Imperfect debugging models with fault introduction rate for software reliability assessment," International Journal of Systems Science, vol. 23, no. 12, pp. 2241–2252, 1992, https://doi.org/10.1080/00207729208949452
  52. Pham and X. Zhang, "An NHPP software reliability model and its comparison," International Journal of Reliability, Quality and Safety Engineering, vol. 4, no. 3, pp. 269–282, Sep. 1997, https://doi.org/10.1142/S0218539397000199
  53. D. Penny, J. Mattout, and N. Trujillo-Barreto, "Bayesian model selection and averaging," in Statistical Parametric Mapping: The Analysis of Functional Brain Images, K. Friston, J. Ashburner, S. Kiebel, T. Nichols, and W. Penny, Eds. Academic Press, 2007, pp. 454–470, https://doi.org/10.1016/B978-012372560-8/50035-8
  54. Stoica and Y. Selen, "Model-order selection: a review of information criterion rules," IEEE Signal Processing Magazine, vol. 21, no. 4, pp. 36–47, 2004, https://doi.org/10.1109/MSP.2004.1311138
  55. J. Friston, W. D. Penny, J. Ashburner, S. J. Kiebel, and T. E. Nichols, Eds. Statistical Parametric Mapping: The Analysis of Functional Brain Images, London: Academic Press, 2006, https://doi.org/10.1016/B978-0-12-372560-8.X5000-1
  56. Iqbal, S. M. K. Quadri, and N. Ahmad, “Software Reliability Growth Models from the Perspective of Learning Effects and Change-Point,” Ph.D. dissertation, Department of Computer Sciences, University of Kashmi, 2014.
  57. Z. Ke and C. Y. Huang, "Software reliability prediction and management: A multiple change‐point model approach," Quality and Reliability Engineering International, vol. 36, no. 5, pp. 1678–1707, 2020, https://doi.org/10.1002/qre.2653
International Journal of Reliability, Risk and Safety: Theory and Application
Volume 8, Issue 1
June 2025
Pages 74-81

  • Receive Date 29 April 2025
  • Revise Date 09 July 2025
  • Accept Date 12 July 2025