Skip to content

Account for truncated empirical distribution in effective transcript length calculation#32

Merged
ctrapnell merged 1 commit into
cole-trapnell-lab:masterfrom
BenLangmead:master
Jul 1, 2015
Merged

Account for truncated empirical distribution in effective transcript length calculation#32
ctrapnell merged 1 commit into
cole-trapnell-lab:masterfrom
BenLangmead:master

Conversation

@BenLangmead

Copy link
Copy Markdown

I noticed a lot of variability in the FPKM estimates for some relatively short isoforms when I would perturb the input BAM a little bit. (Note: the way I would perturb the BAM would affect empirical read/fragment length distributions somewhat.) I traced the variability to the transcript's effective_length and eventually to here.

For the affected gene(s) effective_length was calculated as being less than 1, which was puzzling, and would vary a lot (in relative terms, not in absolute) when input was perturbed. I think this pull request is the fix: the effective length calculation is using the pdf member of the EmpDist class, but should be using npdf because it's considering a truncated version of the emp. dist.

ctrapnell added a commit that referenced this pull request Jul 1, 2015
Account for truncated empirical distribution in effective transcript length calculation
@ctrapnell
ctrapnell merged commit cfb0925 into cole-trapnell-lab:master Jul 1, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants