AFNI Message Board

Dear AFNI users-

We are very pleased to announce that the new AFNI Message Board framework is up! Please join us at:

https://discuss.afni.nimh.nih.gov

Existing user accounts have been migrated, so returning users can login by requesting a password reset. New users can create accounts, as well, through a standard account creation process. Please note that these setup emails might initially go to spam folders (esp. for NIH users!), so please check those locations in the beginning.

The current Message Board discussion threads have been migrated to the new framework. The current Message Board will remain visible, but read-only, for a little while.

Sincerely, AFNI HQ

History of AFNI updates  

|
August 31, 2010 05:16PM
The difference between family-wise error correction (FWE) and false discovery rate (FDR) reflects two different methodologies in handling the multiple testing problem (controlling type I error in the whole brain) of FMRI data analysis. AlphaSim and 3dClustSim belong to the FWE camp.

1) FWE: overall significance in the whole brain = P (≥ one false positive voxel in the whole brain)

- Frequentist’s perspective: Probability among many hypothetical brains
- Used usually for parametric testing

2) FDR = expected % false positive voxels among all "detected" voxels

- Focus: controlling false positives among detected voxels in one brain
- Can be used in parametric and non-parametric testing

3) Concrete example

- Suppose individual voxel p = 0.001 (uncorrected) for a brain of 25,000 EPI voxels
- With such an uncorrected p, on average we expect to have 25 false positive voxels in the whole brain
- In FWE sense: a corrected p = 0.05 means 5% false positives among MANY hypothetical brains for a FIXED voxel location
- In FDR sense: a corrected p = 0.05 indicates 5% voxels among those positively labeled voxels in THE brain are false positives

4) Which one to choose?

It is totally up to you! Since each method emphasizes one perspective in controlling type I error, they don't necessarily end up the same, and may differ dramatically sometimes because of each specific significance landscape in the brain and subtle issues in masking, for example. So in real practice choose whatever pleases you.

Hope this helps,
Gang
Subject Author Posted

Multiple comparisons: fdr vs alphasim/3dclustsim

Stephen Towlrt August 31, 2010 09:21AM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

Gang Chen August 31, 2010 05:16PM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

Nick September 01, 2010 07:54AM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

Gang Chen September 02, 2010 11:41AM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

Nick September 06, 2010 06:20AM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

Gang Chen September 07, 2010 04:39PM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

Nick September 09, 2010 11:29AM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

Gang Chen September 23, 2010 11:37AM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

Nick September 24, 2010 11:16AM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

JoJo June 01, 2013 06:23AM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

gang June 03, 2013 02:23PM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

GregSiegle June 05, 2015 03:17PM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

gang June 05, 2015 05:37PM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

GregSiegle June 07, 2015 11:43AM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

gang June 09, 2015 05:40PM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

Stephen Towler September 01, 2010 08:58AM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

Gang Chen September 02, 2010 11:21AM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

Stephen Towler September 03, 2010 11:47AM

Re: Multiple comparisons: fdr vs alphasim/3dclustsim

Gang Chen September 04, 2010 12:48PM