Accuracy Analysis of Software For The Estimation and Planning of Photovoltaic Installations
Accuracy Analysis of Software For The Estimation and Planning of Photovoltaic Installations
Accuracy Analysis of Software For The Estimation and Planning of Photovoltaic Installations
Abstract
As the use of photovoltaics expands, with more and more commercial and residential users investing on solar
energy systems around the globe, there is substantial demand for relatively simple, easy-to-use software packages
for the planning and performance estimation of photovoltaic installations by installers and architects. In this paper,
the calculative accuracy of TRNSYS, Archelios, Polysun, PVSyst, PV*SOL and PVGIS is being examined in comparison
to the real electrical energy generated by a grid-connected 19.8kWp photovoltaic installation. The assessment has
been performed by using the climatic data which have been recorded at the site of the real photovoltaics (PV) park
over the same calendar year. Our results displayed that the software packages tend to overestimate the global irradiation
received by the PV modules but still significantly underestimate the electrical energy generated by the installation.
Keywords: Photovoltaics; Solar irradiation; PVGIS; Energy Economics; PVSyst; PV*SOL; TRNSYS; Archelios; Polysun
© 2014 Axaopoulos et al. This is an Open Access article distributed under the terms of the Creative Commons Attribution
License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any
medium, provided the original work is properly cited.
Axaopoulos et al. International Journal of Energy and Environmental Engineering 2014, 5:1 Page 2 of 7
http://www.journal-ijeee.com/content/5/1/1
Photovoltaic installation
For the means of this study, long-term performance data The software
have been extracted from an operational PV park in The climatic data extracted from the operational park have
order to be compared to the artificial data created by the been entered into five commercial software packages which
software. This free-standing PV park is situated at an open are available to us and are being alphabetically summarized
field at the foothills of Rhodope, near the settlement in Table 3. PVGIS is not a commercial software and has
Dionis, in Thrace, Greece. The land plot measures nearly been included in this study only in order to assess its
2,000 m2 large, without any obstructions which could accuracy as a quick assessment online tool.
cause shading near the installation. The exact geographical TRNSYS is capable of receiving hourly climatic data,
coordinates of the location are 40.98 N, 25.56 E. and thus, the radiation on the inclined plane H30, the
Table 1 displays the specifications of each of the 90 ambient temperature T and the wind speed U have all
SILCIO SE220 photovoltaic panels used by the PV park, been imported as is, in their hourly values.
which have a total surface of 150 m2. Steel mounts are Archelios is the only commercial software which re-
being used, placing the panels at a tilt angle of 30° and quires the input of the global, diffuse and direct irradi-
facing the true south. The installed power of the PV ation on the horizontal plane, as well as the ambient
park is 19.8 kW, directly connected to the low voltage temperature and wind speed, in monthly values, if the
(230 V AC) distribution grid. For the means of connect- user seeks to generate a custom climatic data file. As
ing to the grid, three SMA Sunny Mini Central 7000TL such, the global irradiation on the horizontal should be
have been used, each with a maximum power output of split to diffuse and direct using either a mathematical
7 kW and an efficiency of 97.7% at maximum output. model or the conversion ratio available for the area of
Two strings of 15 panels each have been connected per the installation. As this study explores the accuracy of
inverter, leading to an inverter configuration oversized the simulation software assuming that it will be used as
by about 6%. a daily tool and from users without high scientific back-
The park has a Sunny Sensorbox weather station in- ground, the simplest option has been selected, and that
stalled, which features Si module sensors for the global is using the diffuse-to-global ratio available for the area,
irradiation, PT100 sensors for the panel and ambient which has been extracted from climatic maps. The results
temperature, as well as a multi-directional anemometer are shown in Table 4.
for the wind speed. The solar irradiation sensors have Polysun requires the entry of the monthly global irradi-
been calibrated with the help of Kipp & Zonen CM 11 ation on the horizontal plane, ambient temperature and
pyranometers [29]. wind speed. PVSyst has similar requirements, but the
wind speed is treated as optional. The monthly values of
Table 1 SILCIO SE220 PV panel specifications these three data sets have been entered into both of these
Performance figure STC rating software packages.
Pnom 220 W PV*SOL requires the entry of the monthly global irradi-
Vmpp 28.8 V
ation on the horizontal plane and ambient temperature.
Even though the algorithm of the software does take wind
Impp 7.65 A
speed into account, there is no option to manually enter it
Voc 36.4 V into the software while creating a custom climatic data set
Isc 8.3 A and the software appears to be randomly generating wind
NOCT 39.95 °C profiles based on the location of the installation.
μVoc −0.30%/°C For the case of the PVGIS, which does not support the
μΙsc +0.047%/°C
manual input of any climatic data, the integrated Climate-
SAF database data is being used. The estimated total
μPmpp −0.39%/°C
system losses have been entered to be 7%.
Axaopoulos et al. International Journal of Energy and Environmental Engineering 2014, 5:1 Page 3 of 7
http://www.journal-ijeee.com/content/5/1/1
Figure 1 Monthly energy generation of the PV park and as calculated by the simulation applications.
The MAD parameter is used to measure statistical dis- Results and discussion
persion and is given by Equation 2: Energy and solar irradiation results
Figure 1 displays the energy generation of the real PV
1X
n park and the figures which each software calculated for
MAD ¼ jH t −F t j ð2Þ a full calendar year. TRNSYS, which is using the irradi-
n t¼1 ation data which have been recorded on the inclined
plane, displays nearly perfect accuracy.
The MAPE parameter, also known as mean absolute As it can be seen from Figure 2, which displays the de-
percentage deviation or MAPD, is used to assess the ac- viation of the calculated results from the real production
curacy of the model and is given by Equation 3: of the PV park, the four commercial PV analysis and
planning applications underestimate the electrical energy
n
1X H t −F t generation of the installation every single month of the
MAPE ¼ 100% ð3Þ year, with the sole exception of PVGIS, which is making
n t¼1 H t
calculations based on its own climatic database and thus
displays great fluctuations each month.
The model efficiency test displays the goodness of fit Figure 3 displays the real global irradiation received by
between the calculated and experimental values, while the the PV modules per month in comparison to that calcu-
highest value it can get is 1. EF is given by Equation 4: lated by each software. Even though the commercial soft-
ware packages underestimate the energy generation of
the PV installation, they actually calculate the global ir-
∑nt¼1 ðH t −zÞ2 −∑nt¼1 ðF t −H t Þ2
EF ¼ ð4Þ radiation received by the panels of the PV park to be
∑nt¼1 ðH t −zÞ2 higher than the real global irradiation on the inclined
plane, as it can be seen in Figure 4. This is a paradox, in-
Where z is the mean value of the experimental data. dicating that the PV planning and analysis applications
Figure 2 Monthly deviation of the calculated energy generation from the actual of the PV park.
Axaopoulos et al. International Journal of Energy and Environmental Engineering 2014, 5:1 Page 5 of 7
http://www.journal-ijeee.com/content/5/1/1
Figure 3 Monthly global irradiation on the 30° plane as calculated by the simulation applications.
overestimate the solar irradiation received by the PV the main source of the electricity generation calculation
panels of the park even though they underestimate the error comes from the PV cell model which each soft-
electricity generation. It also is interesting to note that ware is using.
even though PVGIS greatly overestimates the global ir- Table 5 displays the annual electrical energy gener-
radiation received by the PV panels, the electricity gener- ation and annual global irradiation received on the
ation results are significantly lower than the real output inclined plane.
of the PV park.
As it can also be seen from Figure 4, while the global ir- Error analysis
radiation received by the PV modules that the software According to the statistical parameters used, the data
packages calculate coincides, for certain months, with the calculated from the simulation software better approxi-
global irradiation recorded by the sensors of the park, the mates the experimental data when the values of RMSE,
calculated electricity generation is significantly underesti- MAD and MAPE are close to zero and the values of EF
mated. As such, while the calculated global irradiation approach unity.
of Archelios for February, Polysun for June, PVSyst for As TRNSYS is utilizing the recorded global irradiation
November and PV*SOL for October coincides with the on the inclined plane directly and suffers no irradiation
actual global irradiation received by the modules, the cal- conversion errors, it was expected that the accuracy of
culated electricity generation during those months is the energy generation simulation would be very high. As
respectively 7.6%, 7.5%, 10.2% and 6.1% lower than that it can been seen from Table 6, the energetic results from
of the real PV park. Therefore, it becomes clear that re- TRNSYS display a model efficiency of 99.7%. Leaving
gardless of the method each application is using to convert TRNSYS aside and moving to the PV planning and ana-
the provided global irradiation on the horizontal plane lysis software, Archelios appears to be delivering the most
into the global irradiation on the plane of the PV modules, accurate energy generation results over the course of a
Figure 4 Monthly deviation of the calculated global irradiation on the 30° plane from the actual.
Axaopoulos et al. International Journal of Energy and Environmental Engineering 2014, 5:1 Page 6 of 7
http://www.journal-ijeee.com/content/5/1/1
Table 5 Generated electricity and global irradiation Table 7 Solar irradiation at 30° error analysis
received on the inclined plane per annum Software RMSE MAD MAPE EF
Annual electricity generation (kWh) H30 (kWh/m2) Archelios 5.41 4.85 3.70% 98.94%
Real data 32,443 1,729 Polysun 4.27 3.52 2.67% 99.31%
TRNSYS 32,299 1,729 PVSyst 4.80 4.29 3.22% 99.21%
Archelios 30,923 1,783 PV*SOL 3.07 2.67 2.47% 99.66%
Polysun 30,200 1,772 PVGIS 18.96 15.07 12.81% 88.00%
PVSyst 29,732 1,768
PV*SOL 29,765 1,744 of the energy generation results was the second worst,
PVGIS 30,980 1,910 excluding PVGIS.
Conclusions
year, followed by Polysun. However, the error becomes The calculative accuracy of five commercial applications
significant, with the MAPE of the results from Archelios has been tested and evaluated through a set of four stat-
surpassing 5.1%. PVSyst and PV*SOL display similar error istical parameters, namely RMSE, MAD, MAPE and EF.
results in all four tests, a MAPE of about 9.1% and a The statistical parameters have been used as indicators
model efficiency of about 92.5%. of the goodness of the estimation of the electrical energy
PVSyst and PV*SOL display similar error results when and the global solar irradiation on the inclined surface.
their energy generation figures are being tested; however, The PV planning and analysis applications generally over-
as it can be seen from Table 7, the latter appears signifi- estimate the irradiation received by the PV panels but, at
cantly more accurate than the former when testing the the same time, underestimate the energy generation.
calculated solar irradiation on the inclined plane. PV*SOL The software which is based and or depends on the
also displays the best received global irradiation calcula- PVGIS irradiation database may be significantly inaccur-
tion accuracy and the lowest irradiation overestimation ate, especially if the study is being performed for specific
out of all the tested applications. Despite it displaying months or short time periods.
the most accurate energetic results, the error analysis Even though the conversion of the global irradiation
indicates that Archelios significantly overestimated the on the horizontal plane to the global irradiation on the
irradiation received by the PV installation. plane of the modules is a source of calculation error, the
Combining both the accuracy of the calculated energy main error source comes from the model of the PV cell.
generation and of the calculated received global irradi- Finally, regardless of the deviations which the commercial
ation, Polysun appears to be the most accurate software software packages displayed, it can be considered that the
amongst the PV estimation and planning applications. results are generally useful and that their features and ease
Polysun displays the second most accurate energy gener- of use makes them a vital tool for planning and quickly
ation results and, at the same time, the second most assessing the performance of a PV installation.
accurate received global irradiation results as well. On Future studies may be performed to assess which parts
the other hand, Archelios displayed the most accurate of the complete simulation model used by the software
energy generation results but had the least accurate packages are significant sources of error. Furthermore,
received global irradiation calculation, significantly over- by evaluating how each simulation parameter affects the
estimating the irradiation received by the system, while accuracy of each model, the simulation models may be
PV*SOL displayed the most accurate calculation of the improved accordingly to provide more accurate results.
global irradiation received by the system but the accuracy As displayed in this paper, the main source of error
comes from the model of the PV cell; future research
may be performed to evaluate the accuracy of the PV
Table 6 Energy generation error analysis
simulation model used by each software package against
Software RMSE MAD MAPE EF
real-world performance data and improve these models
TRNSYS 47.46 29.72 1.24% 99.69% to better reflect real-world performance results. Further-
Archelios 141.23 126.67 5.14% 97.16% more, research on the error induced by the solar irradi-
Polysun 200.34 186.90 7.41% 94.30% ation conversion model of each software package from the
PVSyst 234.23 225.92 9.16% 92.47% horizontal to the inclined plane should be performed, in
PV*SOL 230.92 223.18 9.08% 92.66%
order for the models of each software package to be im-
proved so as to accurately convert the irradiation data
PVGIS 244.88 221.42 9.24% 89.93%
from the horizontal to the inclined plane.
Axaopoulos et al. International Journal of Energy and Environmental Engineering 2014, 5:1 Page 7 of 7
http://www.journal-ijeee.com/content/5/1/1
Additional file 17. Minwon, P, In-Keun, Y: A novel real-time simulation technique of photovoltaic
generation systems using RTDS. Energy Convers. IEEE Trans. 19(1), 164–169
(2004). doi:10.1109/TEC.2003.821837
Additional file 1 : Solar Plant Data Log.
18. Gow, JA, Manning, CD: Development of a photovoltaic array model for use
in power-electronics simulation studies. Elect. Pow. Appl. IEE Proc. 146(2),
193–200 (1999). doi:10.1049/ip-epa:19990116
Competing interests 19. Alonso-García, MC, Ruiz, JM, Herrmann, W: Computer simulation of shading
The authors declare that they have no competing interests. effects in photovoltaic arrays. Renew. Energy 31(12), 1986–1993 (2006).
doi:http://dx.doi.org/10.1016/j.renene.2005.09.030
Authors’ contributions 20. Hay, JE, McKay, DC: Estimating solar irradiance on inclined surfaces: a review
AP performed the TRNSYS simulations and the analysis of the data. FE and assessment of methodologies. Int J Sol. Energ. 3(4–5), 203–240 (1985).
performed the literature review, the simulations with the commercial doi:10.1080/01425918508914395
software packages, the error analysis and the English editing. GK performed 21. Sera, D, Teodorescu, R, Rodriguez, P: PV panel model based on datasheet
the on-site PV park inspections and supplied the experimental data. values, pp. 2392–2396. IEEE International Symposium on Industrial
Electronics, Vigo (2007)
Author details 22. Ciobotaru, M, Kerekes, T, Teodorescu, R, Bouscayrol, A: PV inverter
1 simulation using MATLAB/Simulink graphical environment and PLECS
Department of Energy Technology, Technological Educational Institute (TEI)
of Athens, Ag. Spyridonos, Aegaleo 12210, Greece. 2Electronic and Computer blockset, pp. 5313–5318. 32nd Annual Conference on IEEE Industrial
Engineering Department, School of Engineering and Design, Brunel Electronics, Paris (2006)
University, Uxbridge, London, Middlesex UB8 3PH, UK. 23. Maris, TI, Kourtesi, S, Ekonomou, L, Fotis, GP: Modeling of a single-phase
photovoltaic inverter. Sol. Energ. Mat. Sol. C. 91(18), 1713–1725 (2007).
Received: 23 October 2013 Accepted: 13 December 2013 doi:http://dx.doi.org/10.1016/j.solmat.2007.05.027
Published: 02 Jan 2014 24. Hasimah, AR, Khalid, MN, Mohammad, YH: Assessment of PV cell
performance under actual Malaysia operating condition, Australasian
Universities Power Engineering Conference. Adelaide 27–30, 1–5 (2009)
References 25. Cheng, CL, Sanchez Jimenez, CS, Lee, MC: Research of BIPV optimal tilted
1. Denholm, P, Margolis, RM: Evaluating the limits of solar photovoltaics (PV) in angle, use of latitude concept for south orientated plans. Renew. Energy
traditional electric power systems. Energy Policy 35(5), 2852–2861 (2007) 34(6), 1644–1650 (2009). doi:http://dx.doi.org/10.1016/j.renene.2008.10.025
2. Masson, G, Latour, M, Biancardi, D: Global market outlook for photovoltaics 26. Jahn, U, Nasse, W: Operational performance of grid-connected PV systems
until 2016. European Photovoltaic Industry Association, Brussels (2012) on buildings in Germany. Prog. Photovoltaics: Res. Appl. 12(6), 441–448
3. Tyagi, VV, Rahim, NAA, Rahim, NA, Selvaraj, JAL: Progress in solar PV (2004). doi:10.1002/pip.550
technology: research and achievement. Renew. Sustain. Energy Rev. 20(0), 27. Bornatico, R, Pfeiffer, M, Witzig, A, Guzzella, L: Optimal sizing of a solar
443–461 (2013). doi:http://dx.doi.org/10.1016/j.rser.2012.09.028 thermal building installation using particle swarm optimization. Energy
4. Strzalka, A, Alam, N, Duminil, E, Coors, V, Eicker, U: Large scale integration of 41(1), 31–37 (2012)
photovoltaics in cities. Appl. Energy 93, 413–421 (2012) 28. Lundh, M, Wäckelgård, E, Ellegård, K: Design of hot water user profiles for
5. Park, KE, Kang, GH, Kim, HI, Yu, GJ, Kim, JT: Analysis of thermal and electrical Swedish conditions, pp. 2074–2078. Proceedings of ISES World Congress
performance of semi-transparent photovoltaic (PV) module. Energy 35(6), (Vol. I–Vol. V), Springer, Heidelberg (2007)
2681–2687 (2010). doi:10.1016/j.energy.2009.07.019 29. Kipp & Zonen: CM 11 Pyranometer manual. 2013, 2013 (2013). http://www.
6. Agrawal, B, Tiwari, GN: Life cycle cost assessment of building integrated kippzonen.com/Download/48/CM-11-Pyranometer-CM-14-Albedometer-
photovoltaic thermal (BIPVT) systems. Energ. Buildings 42(9), 1472–1481 Manual
(2010). doi:http://dx.doi.org/10.1016/j.enbuild.2010.03.017
7. Kanchev, H, Lu, D, Colas, F, Lazarov, V, Francois, B: Energy management and
10.1186/2251-6832-5-1
operational planning of a microgrid with a PV-based active generator for
Cite this article as: Axaopoulos et al.: Accuracy analysis of software for
smart grid applications. Ind. Electron. IEEE Trans. 58(10), 4583–4592 (2011) the estimation and planning of photovoltaic installations. International
8. Hegger, M, Fuchs, M, Stark, T, Zeumer, M: Energy manual. Birkhäuser (2008) Journal of Energy and Environmental Engineering 2014, 5:1
9. Bazilian, M, Onyeji, I, Liebreich, M, MacGill, I, Chase, J, Shah, J, Gielen, D,
Arent, D, Landfear, D, Zhengrong, S: Re-considering the economics of
photovoltaic power. Renew. Energy 53, 329–338 (2013)
10. Lucas, R, Makhyoun, M: Evaluation of incentives for renewable energy in
today's market. Proceedings of the Solar Conference, American Solar Energy
Society, pp. 2887–2894. , Colo (2012)
11. Hammond, GP, Harajli, HA, Jones, CI, Winnett, AB: Whole systems appraisal
of a UK Building Integrated Photovoltaic (BIPV) system: energy,
environmental, and economic evaluations. Energy Policy 40(0), 219–230
(2012). doi:http://dx.doi.org/10.1016/j.enpol.2011.09.048
12. Santos, IPD, Rüther, R: The potential of building-integrated (BIPV) and
building-applied photovoltaics (BAPV) in single-family, urban residences at
low latitudes in Brazil. Energ. Buildings 50(0), 290–297 (2012). doi:http://dx.
doi.org/10.1016/j.enbuild.2012.03.052 Submit your manuscript to a
13. Defaix, PR, van Sark, WGJHM, Worrell, E, de Visser, E: Technical potential for
photovoltaics on buildings in the EU-27. Sol. Energ. 86(9), 2644–2653 (2012). journal and benefit from:
doi:http://dx.doi.org/10.1016/j.solener.2012.06.007
14. Loulas, NM, Karteris, MM, Pilavachi, PA, Papadopoulos, AM: Photovoltaics in 7 Convenient online submission
urban environment: a case study for typical apartment buildings in Greece. 7 Rigorous peer review
Renew. Energy 48(0), 453–463 (2012). doi:http://dx.doi.org/10.1016/j. 7 Immediate publication on acceptance
renene.2012.06.009 7 Open access: articles freely available online
15. Commission, E: Directive 2010/31/EU of the European Parliament and of the
7 High visibility within the field
Council of 19 May 2010 on the energy performance of buildings (recast).
L153 Official J. Eur. Union 18, 13–35 (2010) 7 Retaining the copyright to your article
16. Kanters, J, Horvat, M, Dubois, MC: Tools and methods used by architects for
solar design. Energ. Buildings (2012). doi:http://dx.doi.org/10.1016/j.
Submit your next manuscript at 7 springeropen.com
enbuild.2012.05.031