NEWS | R Documentation |
there is now a predict
function.
the latest Matrix package (unclear what version caused the issue, maybe 1.6) caused a bug that is fixed by this version of WeMix.
the haven
package doesn't always import data in formats the Matrix
package recognizes. Columns that should be numeric are now cast as numeric before they are used, which may prevent this issue. Thanks to Emilie Franck for pointing this out.
the mix
function documentation now notes that the coefficient standard errors are always cluster robust (CR-0) estimates. Thanks to Francis Huang for pointing out that it previously mentioned a non-existent argument.
the mix
function nolonger fails if the lme4::lmer
fit had a variable of exactly zero because bobyqa
threw an error. Thanks fo Charles Blankenship for identifying this bug.
the functions getHessian2
and getJacobian
are removed from the package because they are not used.
the mix
function now fits weighted binomial and Poisson models with up to three levels. This update uses, at the user's request the LaPlace approximation or adaptive Gauss-Hermite Quadrature (AGHQ). To achieve that, we use penalized iteratively reweighted least squares (PIRLS) with code based on lme4pureR
package by Steve Walker and Doug Bates. Use nQuad=1
for LaPlace, and nQuad>1
for AGHQ.
because of this change the mix
argument acc0
is now deprecated and will be ignored.
many warnings and errors are now clearer
group mean centering and grand mean centering now calculate averages correctly for unbalanced data
group and grand mean centering now always use the level-1 weights
WeMix now fits linear models with any number of levels and has been tested with 4-level models.
WeMix now returns a nicer version of the random effects in the object ranefMat
minor update related to the new CRAN checks.
When estimating the standard errors, the evaluation of the Jacobian was further optimized. Internal tests show a speedup between zero and thirty percent per model fit.
In a three-level linear model, when cWeights=TRUE
, the weights were incorrectly adjusted. This has been fixed.
mix
was not returning on some data that was unsorted, and the function was made more robust to unsorted data.
mix
used to drop rows if they had an NA
on any column, regardless of if it was used in the model. Now it first forms a model frame with the relevant rows before doing this. Thank you to Bernhard Clemm von Hohenberg for pointing out this bug. From https://github.com/American-Institutes-for-Research/WeMix/issues/2.
The documentation for the weights
variable has been improved to indicate what order to put the weights in. Thank you to Bernhard Clemm von Hohenberg for pointing out the possible confusion.
a possible speed up in the solver for linear models uses rbind2
in preference to rbind
The error code when a single weight was passed was unclear. Thank you to Zerleen Quader for identifying this issue.
mix
now works with factor outcomes in a binomial model.
mix
now works with factor IDs.
the final latent estimates were not converging because the Newton steps were not sufficently controlled. They are now more agressively prevented from diverging.
when the variance estimate of a binomial model converged to the minimum variable (about 0.01) the model never acknowledged convergence, it now does.
thanks to Tan Khai Ee and Prof. Taberez A. Neyazi for identifying and helping develop test code for the above four bugs.
non-linear models summary function was not printing correctly. They are now also correctly showing weighted results, similar to linear models in 3.1.7.
the warning for very low variance models in binomial regression was updated to clearly state the limitation of WeMix (it cannot estimate such models), and possible solutions.
with the extended information in Groups
the warning about conditional weights was extranious and so was removed.
improved infomation about weights by level under Groups
header of an mml
summary.
a conditioning variable cannot contain a dot, which now has a clearer error. Thank you to Felix Schulz for identifying this issue.
it is possible to pass an S3 object that claims to extend data frame but does not (such as a tbl_df
) and so now all data objects are cast as a data frame before procesing beings. The specific issue is that a tbl_df
defaults to drop=FALSE
causing a single vector to maintain its name when it is expected to be unnamed.
Models now use less memory when there is a large number of units and groups after switching to a sparse Matrix for the random effects.
The method of forming a generalized inverse was made more robust. It used to try only a QR decomposition based generalized inverse; this is now lest robust for unknown reasons. Now it also tries an SVD decomposition based generalized inverse.
Updated tests to use EdSurvey 2.6.1.
The vignettes should now appear as pdf files on CRAN.
The method used to determine the rank of a matrix was brought into agreement with the base
package when the matrix was a base matrix. Prior to this it was possible to get an error from a call to mix
that should have returned. Now these calls to mix
should return. Thanks to Christian Christrup Kjeldsen of Aarhus University, Danish School of Education, for pointing this issue out.
The Wald test now works for generalized linear models instead of throwing an error. Thanks to Christian Christrup Kjeldsen for pointing this issue out as well.
WeMix
can now accept conditional weights. See the cWeights
argument in the mix
function.
the mix
function checks weights and writes a message if they may be conditional and cWeights
is set to FALSE
.
Linear model evaluation is more robust and can handle data with non-invertible Z matrixes within a group.
Linear models now use base::qr
more aggressively because of poor performance of the Matrix::qr.coef
function on a sparse QR when the system is singular. This previously resulted in very large variance estimates. This also fixed an invalid 'times' argument
error.
The code in the vignette was not the code used to generate the results and some values were incorrectly entered in the comparison table under the mix
column. These problems were fixed.
Linear models are now solved using an analytical solution based on work by Bates and Pinheiro, (1998). This solution is significantly faster than the previous adaptive quadrature method.
Non-linear models are still evaluated using adaptive quadrature.
WeMix can now fit weighted three-level linear models, see the Weighted Linear Mixed-Effects Model vignette for details. Non-linear models are still evaluated using adaptive quadrature and are limited to two-level models.
Model evaluation is now possible using Wald tests. Wald tests allow users to test both fixed effects and random effects variances.
Supports binomial models
Added ability to perform group and grand mean centering to increase comparability with Hierarchical Linear and Nonlinear Modeling (HLM) software
Although three-level models are not currently supported, in version 2.0.0, changes were made to the way groups handled and to the data structures used for integration over random effects so as to be compatible with the future development of three-level models.
Corrected the warning message for the fast option (using Rcpp)
fast
option in mix
defaults to FALSE
now to prioritize accuracy over speed.