Psychometric software refers to specialized programs used for the psychometric analysis of data obtained from tests, questionnaires, polls or inventories that measure latent psychoeducational variables. Although some psychometric analyses can be performed using general statistical software such as SPSS, most require specialized tools designed specifically for psychometric purposes.
Sources of Free Software Numerous free psychometric tools have been developed by researchers and educators. Notable websites and resources offering such software include:
CASMA at the University of Iowa, USA: Hosts the GENOVA Suite of computer programs for generalizability theory. Software from Harold Doran, PACER: Provides web-based and desktop applications for psychometric analysis. REMP at the University of Massachusetts, USA: Provides item response theory software, with the last update in 2008. Software from Brad Hanson: Offers C++ libraries for item response theory (IRT). Software from John Uebersax: Features latent class analysis software. Software from J. Patrick Meyer, jMetrik: Provides open-source software for psychometric analysis. Software from PMaps: Specializes in psychometric assessment software. Software directory at the Institute for Objective Measurement: Lists various psychometric Software from Matthew Courtney, Kevin Chang, Eric Mei, Kane Meissel, Luke Rowe, and Laila Issayeva. There is also an R Shiny tool for reproducible Rasch analysis, differential item functioning, equating, and examination of group effects. Additionally, an increasing number of packages for R can be found in the CRAN Task View: Psychometric Models and Methods.
Classical test theory Classical test theory (CTT) is an approach to psychometric analysis that involves fewer assumptions than item response theory and is more suitable for smaller sample sizes.
Autopsych Autopsych is a free and open-source web app with multiple features for conducting Classical Test Theory (CTT) and Rasch modeling. CTT functions include:
Percentage correct Observed scores for each item category Item-total correlations Item-rest correlations (with user-specified confidence intervals) Item-rest point biserial/polyserial correlations Cronbach’s alpha Alpha-if-deleted Full Pearson correlation matrix (item matrix) with levels of statistical significance Autopsych also performs several Rasch-based functions, including:
Basic Rasch many-facets analysis for differential item functioning (DIF) Fixed item equating for dichotomous item-response matrices One-way ANOVA Inter-rater reliability analysis
CITAS CITAS (Classical Item and Test Analysis Spreadsheet) is a free Excel workbook designed to provide scoring and statistical analysis of classroom tests. Users can type or paste item responses (ABCD) and keys into the workbook, and the output is automatically populated. Unlike some other programs, CITAS does not require any 'running' or experience in psychometric analysis, making it accessible to teachers and professors.
jMetrik jMetrik is free and open-source software for conducting comprehensive psychometric analysis, developed by J. Patrick Meyer at the University of Virginia. It includes methods for:
Classical item analysis Differential item functioning (DIF) analysis Confirmatory factor analysis Item response theory (IRT) IRT equating Nonparametric item response theory jMetrik's item analysis includes proportion, point biserial, and biserial statistics for all response options. It calculates various reliability coefficients include Cronbach's alpha, Guttman's lambda and the Feldt-Gilmer Coefficient. The DIF analysis uses nonparametric item characteristic curves and the Mantel-Haenszel procedure, reporting effect sizes and ETS DIF classifications. IRT methods include the Rasch, partial credit, and rating scale models, with equating methods like mean/mean, mean/sigma, Haebara, and Stocking-Lord procedures. jMetrik also features:
IRT illustrator Basic descriptive statistics Graphics facility for bar charts, pie charts, histograms, kernel density estimates, and line plots jMetrik is a pure Java application that runs on 32-bit and 64-bit versions of Windows, Mac, and Linux operating systems, requires Java 1.6 on the host computer.
Iteman Iteman is a commercial Windows program specifically designed for classical test analysis. It produces tech reports in Microsoft Word with graphics, narratives, and embedded tables. Iteman calculates the proportion and point biserial of each item, high/low subgroup proportions, and detailed item performance graphics. It also provides descriptive statistics, including the mean, standard deviation, reliability, and standard error of measurement, for each domain and the overall tests. Iteman is available from Assessment Systems Corporation.
Lertap Lertap5 (Laboratory of Educational Research Test Analysis Program) is a comprehensive software package for test and survey analyses, developed for Windows and Macintosh computers with Microsoft Excel. Lertap5 includes:
Test, item and option statistics Classification consistency and mastery test analysis Cheating detection procedures Extensive graphics (e.g., trace lines for item options, conditional standard errors of measurement, scree plots, boxplots, histograms, scatterplots) Lertap5 supports both CTT and Rasch item analysis for dichotomous test items. DIF (differential item functioning) is supported using Mantel-Haenszel methods, with graphical results. It also interfaces with R and R Studio, producing data and control files for various IRT programs like Xcalibre and Bilog MG, and preparing data for SAS. Lertap5 was developed by Larry Nelson at Curtin University and is available from Lertap5.com.
TAP TAP (Test Analysis Program) is a free Windows program written in Delphi Pascal that performs test and item analyses based on classical test theory. TAP provides reports on examinee total scores, item statistics (e.g., item difficulty, item discrimination, point-biserial), options analyses, and other useful information. It also provides individual examinee reports of total scores and item responses.
ViSta-CITA ViSta-CITA (Classical Item and Test Analysis) is a module within the Visual Statistics System (ViSta) that applies graphical-oriented methods to psychometric analysis. Developed by Ruben Ledesma, J. Gabriel Molina, Pedro M. Valero-Mora, and Forrest W. Young. ViSta has not been updated since 2014.
… excerpt ends here. Continue reading the full article.
