Open-source software assessment
methodologies
Several methods have been created to dene an assess- 2 Comparison
ment process for free/open-source software. Some fo-
cus on some aspects like the maturity, the durability and
2.1 Comparison criteria
the strategy of the organisation around the open-source
project itself. Other methodologies add functional as-
Stol and Babar have proposed a comparison framework
pects to the assessment process.
for OSS evaluation methods. Their framework lists cri-
teria in four categories: criteria related to the context in
which the method is to be used, the user of the method,
1 Existing methodologies the process of the method, and the evaluation of the
method (e.g., its validity and maturity stage).
There are more than 20 dierent OSS evaluation The comparison presented below is based on the follow-
methods.[1] ing (alternative set of) criteria:
Open Source Maturity Model (OSMM) from Seniority : the methodology birth date.
Capgemini Original authors/sponsors : original methodology
authors and sponsoring entity (if any)
Open Source Maturity Model (OSMM) from
Navica License : Distribution and usage license for the
methodology and the resulting assessments
Open Source Maturity Model (OSSMM) by Woods
and Guliani[2] Assessment model :
Methodology of Qualication and Selection of Detail levels : several levels of details or as-
Open Source software (QSOS) sessment granularity
Predened criteria : the methodology provides
Open Business Readiness Rating (OpenBRR) some predened criteria
Technical/functional criteria : the methodol-
Open Business Quality Rating (OpenBQR) [3]
ogy permits the use of domain specic criteria
QualiPSo [4] based on technical information or features
Scoring model :
QualiPSo Model for Open Source Software Trust-
worthiness (MOSST)[5][6] Scoring scale by criterion
Iterative process : the assessment can be per-
Towards A Trustworthiness Model For Open Source
formed and rened using several steps improv-
Software: How to evaluate Open Source Software [7]
ing the level of details
QualOSS Quality of Open Source Criteria weighting : it is possible to apply
weighting on the assessed criteria as part of the
Evaluation Framework for Open Source Software[8] methodology scoring model
A Quality Model for OSS Selection[9] Comparison : the comparison process is dened by
the methodology
Atos Origin Method for Qualication and Selection
of Open Source Software (QSOS)[10]
2.2 Comparison chart
Observatory for Innovation and Technological trans-
fer on Open Source software (OITOS)[11]
3 See also
Framework for OS Critical Systems Evaluation
(FOCSE)[12] Open Source Maturity Model
1
2 5 EXTERNAL LINKS
Open-source software assessment methodologies: [11] Cabano, M., Monti, C., Piancastelli, G.: Context-
Dependent * Evaluation Methodology for Open Source
Open Business Quality Rating (OpenBQR)[3] Software. In: Proc. Third IFIP WG 2.13 International
OpenBRR Conference on Open Source Systems (OSS 2007), Lim-
erick, Ireland, pp. 301306 (2007)
QSOS
[12] Ardagna, C.A., Damiani, E., Frati, F.: FOCSE: An
The QualiPSo OpenSource Maturity Model (OMM) OWA-based Evaluation Framework for OS Adoption in
Critical Environments. In: Proc. Third IFIP WG 2.13
Free software International Conference on Open Source Systems, Lim-
erick, Ireland, pp. 316 (2007)
Open source
5 External links
4 References
OSMM from Capgemini
[1] Klaas-Jan Stol, Muhammad Ali Babar. A Comparison
Framework for Open Source Software Evaluation Meth- OSMM from Navica
ods published in OSS 2010 proceedings. IFIP AICT vol.
319, pp. 389-394. QSOS
[2] Woods, D., Guliani, G.: Open Source for the Enterprise: OpenBRR
Managing Risks Reaping Rewards. OReilly Media, Inc.,
Sebastopol (2005)
Master thesis on open source selection (In danish)
[3] Taibi, Davide; Lavazza, Luigi; Morasca, Sandro. Enterprise Maturity Assessment Model (freeware)
OpenBQR: A framework for the assessment of OSS
Enterprise Architecture Maturity Assessment
(PDF). In International Conference on Open Source De-
Model Software freeware
velopment, Adoption and Innovation. pp. 173186.
doi:10.1007/978-0-387-72486-7_14. Archived (PDF) Ocial QualiPSo OMM webpages
from the original on August 2007.
[4] [Link]
[5] V. Del Bianco, L. Lavazza, S. Morasca, D. Taibi and D.
Tosi.: Quality of Open Source Software: The QualiPSo
Trustworthiness Model. In: proc. 5th IFIP WG 2.13
International Conference on Open Source Systems, OSS
2009, Skvde, Sweden, June 36, 2009. Proceedings
[6] V. Del Bianco, L. Lavazza, S. Morasca, D. Taibi and D.
Tosi.: The QualiSPo approach to OSS product quality
evaluation. ACM/IEEE, In Proceedings of the IEEE In-
ternational Workshop on Free Libre Open Source Soft-
ware (FLOSS) Colocated with ICSE, 2010
[7] [Link]: Towards a trustworthiness model for Open
Source Software:How to evaluate Open Source Software.
LAP LAMBERT Academic Publishing. 2010. ISBN
3844389687
[8] Koponen, T., Hotti, V.: Evaluation framework for open
source software. In: Proc. Software Engineering and
Practice (SERP), Las Vegas, Nevada, USA, June 2124
(2004)
[9] Sung, W.J., Kim, J.H., Rhew, S.Y.: A Quality Model for
Open Source Software Selec- tion. In: Proc. Sixth In-
ternational Conference on Advanced Language Process-
ing and Web Information Technology, Luoyang, Henan,
China, pp. 515519 (2007)
[10] Atos Origin: Method for Qualication and Selection of
Open Source software (QSOS) version 1.6, Technical Re-
port (2006)
3
6 Text and image sources, contributors, and licenses
6.1 Text
Open-source software assessment methodologies Source: [Link]
methodologies?oldid=787422844 Contributors: Nyco~enwiki, Den fjttrade ankan~enwiki, Ads, Chowbok, Gronky, Luc Pionchon,
Tabletop, Qwertyca, Tony1, SmackBot, Bluebot, CmdrObot, Opilot, R'n'B, Iulus Ascanius, Kl4m-AWB, SF007, MystBot, Ad-
dbot, AnomieBOT, LilHelpa, Armbrust, Mark Schierbecker, FrescoBot, Etiel, BG19bot, Botacco, Srednuas Lenoroc, Sam-m888,
InternetArchiveBot, GreenC bot, Magic links bot and Anonymous: 15
6.2 Images
File:Free_and_open-source_software_logo_(2009).svg Source: [Link]
open-source_software_logo_%282009%[Link] License: Public domain Contributors: FOSS [Link] Original artist: Free Software Portal
[Link] (FOSS [Link]): ViperSnake151
6.3 Content license
Creative Commons Attribution-Share Alike 3.0