Skip to main content
SpringerLink
Log in

Formative evaluation of electricity distribution utilities using data envelopment analysis

  • Case-oriented Paper
  • Published:
Journal of the Operational Research Society

Abstract

The use of Data Envelopment Analysis (DEA) in the electricity distribution sector has been prolific in the number of papers published in research journals. However, while numerous studies have been documented, they have mostly been summative. Their aim has been predominantly descriptive and classificatory. This paper argues that evaluations of a formative nature are more effective than summative studies in promoting a better understanding of the structures and processes of electricity distribution utilities and, consequently, are more appropriate to contribute to performance improvement. To illustrate the use of DEA for formative evaluation, and highlight some of the difficulties of using DEA in practice, this paper compares the cost-efficiency of the Portuguese electricity distribution companies from 2002 to 2006. A dynamic analysis using Malmquist Indices is also conducted in order to evaluate the changes in productivity over this period. Our analysis shows that the application of DEA for formative purposes meets some difficulties. In particular it shows that while the modelling of productivity/efficiency scores using DEA is relatively straightforward, it is comparatively more difficult to develop models that are economically valid and that produce results with face validity. On the basis of the insights derived from this analysis, the paper provides some recommendations regarding the successful application of DEA for performance improvement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Agrell PJ, Bogetoft P and Tind J (2005). DEA and dynamic yardstick competition in Scandinavian electricity distribution. J Prod Anal 23: 173–201.

    Article  Google Scholar 

  • Allen R, Athanassopoulos A, Dyson RG and Thanassoulis E (1997). Weight restrictions and value judgements in data envelopment analysis: Evolution, development and future directions. Ann Opns Res 73: 13–34.

    Article  Google Scholar 

  • Arocena P (2008). Cost and quality gains from diversification and vertical integration in the electricity industry: A DEA approach. Energ Econ 30: 39–58.

    Article  Google Scholar 

  • Azadeh A, Ghaderi SF, Omrani H and Eivazy H (2009a). An integrated DEA-COLS-SFA algorithm for optimization and policy making of electricity distribution units. Energ Policy 37: 2605–2618.

    Article  Google Scholar 

  • Azadeh A, Ghaderi SF and Omrani H (2009b). A deterministic approach for performance assessment and optimization of power distribution units in Iran. Energ Policy 37: 274–280.

    Article  Google Scholar 

  • Bagdadioglu N, Price CW and Weyman-Jones TG (1996). Efficiency and ownership in electricity distribution: A nonparametric model of the Turkish experience. Energ Econ 18: 1–23.

    Article  Google Scholar 

  • Berg S, Lin C and Tsaplin V (2005). Regulation of state-owned and privatized utilities: Ukraine electricity distribution company performance. J Regul Econ 28 : 259–287.

    Article  Google Scholar 

  • Boussofiane A, Dyson RG and Thanassoulis E (1991). Applied data envelopment analysis. Eur J Opl Res 52: 1–15.

    Article  Google Scholar 

  • Caves DW, Christensen LR and Diewert DE (1982). The economic theory of index numbers and the measurement of input, output, and productivity. Econometrica 50 : 1393–1414.

    Article  Google Scholar 

  • Charnes A, Cooper WW and Rhodes E (1978). Measuring the efficiency of decision making units. Eur J Opl Res 26 : 429–444.

    Article  Google Scholar 

  • Charnes A, Cooper WW, Divine D, Ruefli TW and Thomas D (1989). Comparisons of DEA and existing ratio and regression systems for effecting efficiency evaluations of regulated electric cooperatives in Texas. Res Gov Non Acc 5: 187–210.

    Google Scholar 

  • Chen T (2002). An assessment of technical efficiency and cross-efficiency in Taiwan's electricity distribution sector. Eur J Opl Res 137: 421–433.

    Article  Google Scholar 

  • Chien CF, Lo FY and Lin JT (2003). Using DEA to measure the relative efficiency of the service center and improve operation efficiency through reorganization. IEEE T Power Syst 18 (1): 366–373.

    Article  Google Scholar 

  • Cooper WW, Seiford L and Tone K (2000). Data Envelopment Analysis: A Comprehensive Text with Models, Applications, References and DEA-Solver Software. Kluwer Academic Publishers: Massachusetts.

    Google Scholar 

  • Cooper WW, Seiford L and Zhu J (2004). Handbook on Data Envelopment Analysis. Kluwer Academic Publishers: Massachusetts.

    Book  Google Scholar 

  • Cullmann A and von Hirschhausen C (2008a). From transition to competition: Dynamic efficiency analysis of Polish electricity distribution companies. Econ Transit 16 : 335–357.

    Article  Google Scholar 

  • Cullmann A and von Hirschhausen C (2008b). Efficiency analysis of East European electricity distribution in transition: Legacy of the past? J Prod Anal 29: 155–167.

    Article  Google Scholar 

  • Dyson RG, Allen R, Camanho AS, Podinovski VV, Sarrico CS and Shale EA (2001). Pitfalls and protocols in DEA. Eur J Opl Res 132: 245–259.

    Article  Google Scholar 

  • Edvardsen DF and Førsund FR (2003). International benchmarking of electricity distribution utilities. Resour Energy Econ 25: 353–371.

    Article  Google Scholar 

  • Estache A, Rossi MA and Ruzzier CA (2004). The case for international coordination of electricity regulation: Evidence from the measurement of efficiency in South America. J Regul Econ 25 : 271–295.

    Article  Google Scholar 

  • Estache A, Tovar B and Trujillo L (2008). How efficient are African electricity companies? Evidence from the Southern African countries. Energ Policy 36: 1969–1979.

    Article  Google Scholar 

  • Färe R, Grosskopf S and Logan J (1983). The relative efficiency of Illinois electric utilities. Resour Energ 5 : 349–367.

    Article  Google Scholar 

  • Färe R, Grosskopf S, Lindgren B and Roos P (1989, 1994). Productivity change in Swedish hospitals: A Malmquist output index approach. In: Charnes A, Cooper WW, Lewin AY and Seiford ML (eds). Data Envelopment Analysis: Theory, Methodology and Applications. Kluwer Academic Publishers: Boston, pp 253–272.

    Google Scholar 

  • Førsund FR and Kittelsen SC (1998). Productivity development of Norwegian electricity distribution utilities. Resour Energy Econ 20: 207–224.

    Article  Google Scholar 

  • Giannakis D, Jamasb T and Pollitt M (2005). Benchmarking and incentive regulation of quality of service: An application to the UK electricity distribution networks. Energ Policy 33: 2256–2271.

    Article  Google Scholar 

  • Golany B and Roll Y (1993). Some extensions of techniques to handle non-discretionary factors in data envelopment analysis. J Prod Anal 4 : 419–432.

    Article  Google Scholar 

  • Haney AB and Pollitt MG (2009). Efficiency analysis of energy networks: An international survey of regulators. Energ Policy 37: 5814–5830.

    Article  Google Scholar 

  • Hattori T, Jamasb T and Pollitt M (2005). Electricity distribution in the UK and Japan: A comparative efficiency analysis 1985–1998. Energy J 26 (2): 23–47.

    Article  Google Scholar 

  • Hess B and Cullmann A (2007). Efficiency analysis of East and West German electricity distribution companies—Do the ‘Ossis’ really beat the ‘Wessis’? Util Policy 15: 206–214.

    Article  Google Scholar 

  • Hjalmarsson L and Veiderpass A (1992). Efficiency and ownership in Swedish electricity retail distribution. J Prod Anal 3: 7–23.

    Article  Google Scholar 

  • Jamasb T and Pollitt M (2003). International benchmarking and regulation: An application to European electricity distribution utilities. Energ Policy 31: 1609–1622.

    Article  Google Scholar 

  • Korhonen P and Syrjänen MJ (2003). Evaluation of cost efficiency in Finnish electricity distribution. Ann Opns Res 121: 105–122.

    Article  Google Scholar 

  • Kumbhakar SC and Hjalmarsson L (1998). Relative performance of public and private ownership under yardstick competition: Electricity retail distribution. Eur Econ Rev 42: 97–122.

    Article  Google Scholar 

  • Lins MPE, Sollero MKV, Calôba GM and Silva ACM (2007). Integrating the regulatory and utility firm perspectives, when measuring the efficiency of electricity distribution. Eur J Opl Res 181: 1413–1424.

    Article  Google Scholar 

  • Lo FY, Chien CF and Lin JT (2001). A DEA study to evaluate the relative efficiency and investigate the district reorganization of the Taiwan Power Company. IEEE T Power Syst 16: 170–178.

    Article  Google Scholar 

  • Malmquist S (1953). Index numbers and indifference surfaces. Trab Estad 4: 209–242.

    Article  Google Scholar 

  • Miliotis PA (1992). Data envelopment analysis applied to electricity distribution districts. J Opl Res Soc 43 : 549–555.

    Article  Google Scholar 

  • Pacudan R and de Guzman E (2002). Impact of energy efficiency policy to productive efficiency of electricity distribution industry in the Philippines. Energ Econ 24: 41–54.

    Article  Google Scholar 

  • Pahwa A, Feng X and Lubkerman D (2002). Performance evaluation of electric distribution utilities based on data envelopment analysis. IEEE T Power Syst 17 : 400–405.

    Google Scholar 

  • Pardina MA, Rossi MA and Ruzzier CA (1998). Fronteras de eficiencia en el sector de distribución de energía eléctrica: la experiencia sudamericana. Anais XX Enc Bras Economet II: 381–400.

    Google Scholar 

  • Pérez-Reyes R and Tovar B (2009). Measuring efficiency and productivity change (PTF) in the Peruvian electricity distribution companies after reforms. Energ Policy 37: 2249–2261.

    Article  Google Scholar 

  • Podinovski VV (2004). Production trade-offs and weight restrictions in data envelopment analysis. J Opl Res Soc 55: 1311–1322.

    Article  Google Scholar 

  • Podinovski VV (2005). The explicit role of weight bounds in models of data envelopment analysis. J Opl Res Soc 56: 1408–1418.

    Article  Google Scholar 

  • Podinovski VV (2006). Improving data envelopment analysis by the use of production trade-offs. J Opl Res Soc 58: 1261–1270.

    Article  Google Scholar 

  • Pollitt M (1995). Ownership and Performance in Electric Utilities: The International Evidence on Privatisation and Efficiency. Oxford University Press: Oxford.

    Google Scholar 

  • Pollitt M (2005). The role of efficiency estimates in regulatory price reviews: Ofgem's approach to benchmarking electricity networks. Util Policy 13: 279–288.

    Article  Google Scholar 

  • Pombo C and Taborda R (2006). Performance and efficiency in Colombia's power distribution system: Effects of the 1994 reform. Energ Econ 28: 339–369.

    Article  Google Scholar 

  • Ramos-Real FJ, Tovar B, Iootty M, Almeida EF and Pinto Jr HQ (2009). The evolution and main determinants of productivity in Brazilian electricity distribution 1998–2005: An empirical analysis. Energ Econ 31: 298–305.

    Article  Google Scholar 

  • Resende M (2002). Relative efficiency measurement and prospects for yardstick competition in Brazilian electricity distribution. Energ Policy 30: 637–647.

    Article  Google Scholar 

  • Sadjadi SJ and Omrani H (2008). Data envelopment analysis with uncertain data: An application for Iranian electricity distribution companies. Energ Policy 36: 4247–4254.

    Article  Google Scholar 

  • Sanhueza R, Rudnick H and Lagunas H (2004). DEA efficiency for the determination of the electric power distribution added value. IEEE T Power Syst 19 : 919–925.

    Article  Google Scholar 

  • Scheel H (2000). EMS: Efficiency Measurement System User's Manual Version 1.3. Universitat Dortmund: Dortmund, Germany.

    Google Scholar 

  • Scriven M (1967). The methodology of evaluation. In: Tyler RW, Gagne RM and Scriven M (eds). Perspectives on Curriculum Evaluation. Rand McNally: Chicago, pp 39–83.

    Google Scholar 

  • Tanure JEPS, Tahan CMV and Lima JWM (2006). Establishing quality performance of distribution companies based on yardstick regulation. IEEE T Power Syst 21 : 1148–1153.

    Article  Google Scholar 

  • Thakur T, Deshmukh SG and Kaushik SC (2006). Efficiency evaluation of the state owned electric utilities in India. Energ Policy 34: 2788–2804.

    Article  Google Scholar 

  • Tone K (2001). A slacks-based measure of efficiency in data envelopment analysis. Eur J Opl Res 130: 498–509.

    Article  Google Scholar 

  • Tone K (2004). Malmquist Productivity Index: Efficiency change over time. In: Cooper WW, Seiford LM and Zhu J (eds). Handbook on Data Envelopment Analysis. Kluwer Academic Publishers: London, pp 203–227.

    Chapter  Google Scholar 

  • Tsutsui M and Goto M (2009). A multi-division efficiency evaluation of US electric power companies using a weighted slacks-based measure. Socio-Econ Plan Sci 43: 201–208.

    Article  Google Scholar 

  • Von Hirschhausen C, Cullmann A and Kappeler A (2006). Efficiency analysis of German electricity distribution utilities—Non-parametric and parametric tests. Appl Econ 38: 2553–2566.

    Article  Google Scholar 

  • Weyman-Jones TG (1991). Productive efficiency in a regulated industry: The area electricity boards of England and Wales. Energ Econ 13: 116–122.

    Article  Google Scholar 

  • Weyman-Jones TG (1995). Problems of yardstick regulation in electricity distribution. In: Bishop M, Kay J and Mayer C (eds). The Regulatory Challenge. Oxford University Press: Oxford, pp 423–443.

    Google Scholar 

  • Weyman-Jones TG, Boucinha J, Inácio CF, Godinho C and Martins P (2004). Slacks based efficiency measurement: An application to electricity networks. 4th International Symposium on DEA; Aston University.

  • Weyman-Jones TG, Boucinha J and Inácio CF (2008). Efficiency analysis of maintenance and outage repair in electricity distribution. Portuguese J Mngt Stud XIII: 89–110.

    Google Scholar 

  • Wholey JS (1996). Formative and summative evaluation: Related issues in performance measurement. Eval Pract 17 : 145–149.

    Article  Google Scholar 

  • Yang C and Lu WM (2006). Assessing the performance and finding the benchmarks of the electricity distribution districts of Taiwan Power Company. IEEE T Power Syst 21 : 853–861.

    Article  Google Scholar 

  • Yu W, Jamasb T and Pollitt M (2009). Does weather explain cost and quality performance? An analysis of UK electricity distribution companies. Energ Policy 37: 4177–4188.

    Article  Google Scholar 

  • Zhang Y and Bartels R (1998). The effects of sample size on the mean efficiency in DEA with an application to electricity distribution in Australia, Sweden and New Zealand. J Prod Anal 9: 187–204.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Algarve, Portugal

    S P Santos & C A F Amado

  2. EDP Distribuição, Faro, Portugal

    J R Rosado

Authors
  1. S P Santos
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. C A F Amado
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. J R Rosado
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to S P Santos.

Appendix

Appendix

See Table A1.

Table A1 Studies of efficiency measurement of electricity distribution utilities using DEA
Full size table

Rights and permissions

Reprints and permissions

About this article

Cite this article

Santos, S., Amado, C. & Rosado, J. Formative evaluation of electricity distribution utilities using data envelopment analysis. J Oper Res Soc 62, 1298–1319 (2011). https://doi.org/10.1057/jors.2010.66

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1057/jors.2010.66

Keywords

Search

Navigation