Fast calculation of restricted maximum likelihood methods for unstructured high-throughput data

Shengxin Zhu*

*Corresponding author for this work

Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

7 Citations (Scopus)

Abstract

Linear mixed models are often used for analysing unbalanced data with certain missing values in a broad range of applications. The restricted maximum likelihood method is often preferred to estimate co-variance parameters in such models due to its unbiased estimation of the underlying variance parameters. The restricted log-likelihood function involves log determinants of a complicated co-variance matrix which are computational prohibitive. An efficient statistical estimate of the underlying model parameters and quantifying the accuracy of the estimation requires the observed or the Fisher information matrix. Standard approaches to compute the observed and Fisher information matrix are computationally prohibitive. Customized algorithms are of highly demand to keep the restricted log-likelihood method scalable for increasing high-throughput unbalanced data sets. In this paper, we explore how to leverage an information splitting technique and dedicate matrix transform to significantly reduce computations. Together with a fill-in reducing multi-frontal sparse direct solvers, this approach improves performance of the computation process.

Original languageEnglish
Title of host publication2017 IEEE 2nd International Conference on Big Data Analysis, ICBDA 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages40-43
Number of pages4
ISBN (Electronic)9781509036189
DOIs
Publication statusPublished - 20 Oct 2017
Event2nd IEEE International Conference on Big Data Analysis, ICBDA 2017 - Beijing, China
Duration: 10 Mar 201712 Mar 2017

Publication series

Name2017 IEEE 2nd International Conference on Big Data Analysis, ICBDA 2017

Conference

Conference2nd IEEE International Conference on Big Data Analysis, ICBDA 2017
Country/TerritoryChina
CityBeijing
Period10/03/1712/03/17

Keywords

  • Fisher-scoring algorithm
  • fill-in reducing algorithm
  • linear mixed model
  • multi-frontal factorization
  • restricted log-likelihood
  • unbalanced data

Fingerprint

Dive into the research topics of 'Fast calculation of restricted maximum likelihood methods for unstructured high-throughput data'. Together they form a unique fingerprint.

Cite this