AFNI Message Board

Dear AFNI users-

We are very pleased to announce that the new AFNI Message Board framework is up! Please join us at:

https://discuss.afni.nimh.nih.gov

Existing user accounts have been migrated, so returning users can login by requesting a password reset. New users can create accounts, as well, through a standard account creation process. Please note that these setup emails might initially go to spam folders (esp. for NIH users!), so please check those locations in the beginning.

The current Message Board discussion threads have been migrated to the new framework. The current Message Board will remain visible, but read-only, for a little while.

Sincerely, AFNI HQ

History of AFNI updates  

|
August 28, 2018 12:57AM
Hi all,
I failed to use the -Clustsim option in an independent t-test on two samples (n1 = 22, n2 = 23).

My afni version:
Precompiled binary linux_ubuntu_16_64: Aug 22 2018 (Version AFNI_18.2.14)

my script:
datapath="../data"
3dttest++ -setA C2 \
s031 ${datapath}/stat_s031_MNI3mm_Blur6.nii.gz'[7]' \
s045 ${datapath}/stat_s045_MNI3mm_Blur6.nii.gz'[7]' \
s024 ${datapath}/stat_s024_MNI3mm_Blur6.nii.gz'[7]' \
s034 ${datapath}/stat_s034_MNI3mm_Blur6.nii.gz'[7]' \
s025 ${datapath}/stat_s025_MNI3mm_Blur6.nii.gz'[7]' \
s040 ${datapath}/stat_s040_MNI3mm_Blur6.nii.gz'[7]' \
s009 ${datapath}/stat_s009_MNI3mm_Blur6.nii.gz'[7]' \
s019 ${datapath}/stat_s019_MNI3mm_Blur6.nii.gz'[7]' \
s054 ${datapath}/stat_s054_MNI3mm_Blur6.nii.gz'[7]' \
s023 ${datapath}/stat_s023_MNI3mm_Blur6.nii.gz'[7]' \
s017 ${datapath}/stat_s017_MNI3mm_Blur6.nii.gz'[7]' \
s042 ${datapath}/stat_s042_MNI3mm_Blur6.nii.gz'[7]' \
s029 ${datapath}/stat_s029_MNI3mm_Blur6.nii.gz'[7]' \
s044 ${datapath}/stat_s044_MNI3mm_Blur6.nii.gz'[7]' \
s051 ${datapath}/stat_s051_MNI3mm_Blur6.nii.gz'[7]' \
s053 ${datapath}/stat_s053_MNI3mm_Blur6.nii.gz'[7]' \
s001 ${datapath}/stat_s001_MNI3mm_Blur6.nii.gz'[7]' \
s049 ${datapath}/stat_s049_MNI3mm_Blur6.nii.gz'[7]' \
s028 ${datapath}/stat_s028_MNI3mm_Blur6.nii.gz'[7]' \
s047 ${datapath}/stat_s047_MNI3mm_Blur6.nii.gz'[7]' \
s005 ${datapath}/stat_s005_MNI3mm_Blur6.nii.gz'[7]' \
s027 ${datapath}/stat_s027_MNI3mm_Blur6.nii.gz'[7]' \
-setB C1 \
s006 ${datapath}/stat_s006_MNI3mm_Blur6.nii.gz'[7]' \
s055 ${datapath}/stat_s055_MNI3mm_Blur6.nii.gz'[7]' \
s013 ${datapath}/stat_s013_MNI3mm_Blur6.nii.gz'[7]' \
s018 ${datapath}/stat_s018_MNI3mm_Blur6.nii.gz'[7]' \
s016 ${datapath}/stat_s016_MNI3mm_Blur6.nii.gz'[7]' \
s020 ${datapath}/stat_s020_MNI3mm_Blur6.nii.gz'[7]' \
s022 ${datapath}/stat_s022_MNI3mm_Blur6.nii.gz'[7]' \
s048 ${datapath}/stat_s048_MNI3mm_Blur6.nii.gz'[7]' \
s052 ${datapath}/stat_s052_MNI3mm_Blur6.nii.gz'[7]' \
s030 ${datapath}/stat_s030_MNI3mm_Blur6.nii.gz'[7]' \
s050 ${datapath}/stat_s050_MNI3mm_Blur6.nii.gz'[7]' \
s056 ${datapath}/stat_s056_MNI3mm_Blur6.nii.gz'[7]' \
s043 ${datapath}/stat_s043_MNI3mm_Blur6.nii.gz'[7]' \
s035 ${datapath}/stat_s035_MNI3mm_Blur6.nii.gz'[7]' \
s039 ${datapath}/stat_s039_MNI3mm_Blur6.nii.gz'[7]' \
s033 ${datapath}/stat_s033_MNI3mm_Blur6.nii.gz'[7]' \
s036 ${datapath}/stat_s036_MNI3mm_Blur6.nii.gz'[7]' \
s038 ${datapath}/stat_s038_MNI3mm_Blur6.nii.gz'[7]' \
s026 ${datapath}/stat_s026_MNI3mm_Blur6.nii.gz'[7]' \
s032 ${datapath}/stat_s032_MNI3mm_Blur6.nii.gz'[7]' \
s041 ${datapath}/stat_s041_MNI3mm_Blur6.nii.gz'[7]' \
s012 ${datapath}/stat_s012_MNI3mm_Blur6.nii.gz'[7]' \
s046 ${datapath}/stat_s046_MNI3mm_Blur6.nii.gz'[7]' \
-prefix tomNetwork_C2-C1_withinBrain_beta.nii.gz \
-toz \
-mask meanBrainMask+tlrc. \
-Clustsim

Output:
++ 3dttest++: AFNI version=AFNI_18.2.14 (Aug 22 2018) [64-bit]
++ Authored by: Zhark++
++ option -setA :: processing as LONG form (label label dset label dset ...)
++ option -setB :: processing as LONG form (label label dset label dset ...)
++ 74520 voxels in -mask dataset
++ Number of -Clustsim threads set to 8
+ Default clustsim prefix set to 'tomNetwork_C2-C1_withinBrain_beta.nii.gz'
++ 2-sample test: '-AminusB' option is assumed
++ 2-sample test: results will be C2 - C1
++ loading -setA datasets
++ loading -setB datasets
++ Memory usage now = 34,372,988 (34 million [mega])
++ t-testing:0123456789.0123456789.0123456789.0123456789.0123456789.!
++ ---------- End of analyses -- freeing workspaces ----------
++ Memory usage now = 68,047,644 (68 million [mega])
++ Creating FDR curves in output dataset
++ Smallest FDR q [1 C2-C1_Zscr] = 0.0295759
++ Smallest FDR q [3 C2_Zscr] = 5.32057e-08
++ Smallest FDR q [5 C1_Zscr] = 5.27788e-09
+ Added 3 FDR curves to dataset
++ Output dataset ./tomNetwork_C2-C1_withinBrain_beta.nii.gz
++ Output dataset ./tomNetwork_C2-C1_withinBrain_beta.nii.gz.resid.nii
+ 2-sample test: results are C2 - C1
++ ================ Starting -Clustsim calculations ================
+ === temporary files will have prefix tomNetwork_C2-C1_withinBrain_beta.nii.gz ===
+ === running 8 -randomsign jobs (1250 iterations per job) ===
+ === creating 1,490,400,000 (1.5 billion [giga]) bytes of pseudo-data in .sdat files ===
+ --- 3dClustSim reads .sdat files to compute cluster-threshold statistics ---
+ --- there is 16,720,445,440 (17 billion [giga]) bytes of memory on your system ---
++ 3dttest++: AFNI version=AFNI_18.2.14 (Aug 22 2018) [64-bit]
++ Authored by: Zhark++
++ 74520 voxels in -mask dataset
++ option -setA :: processing as SHORT form (all values are datasets)
++ 3dttest++: AFNI version=AFNI_18.2.14 (Aug 22 2018) [64-bit]
++ Authored by: Zhark++
++ option -setB :: processing as SHORT form (all values are datasets)
++ random seeds are 255669912 569829177
++ 2-sample test: '-AminusB' option is assumed
++ 2-sample test: results will be SetA - SetB
++ opened file ./tomNetwork_C2-C1_withinBrain_beta.sdat for output
++ loading -setA datasets
++ 3dttest++: AFNI version=AFNI_18.2.14 (Aug 22 2018) [64-bit]
++ Authored by: Zhark++
++ 74520 voxels in -mask dataset
++ option -setA :: processing as SHORT form (all values are datasets)
++ option -setB :: processing as SHORT form (all values are datasets)
++ random seeds are 256781063 570940328
++ 2-sample test: '-AminusB' option is assumed
++ 2-sample test: results will be SetA - SetB
++ opened file ./tomNetwork_C2-C1_withinBrain_beta.sdat for output
++ loading -setA datasets
++ loading -setB datasets
++ 3dttest++: AFNI version=AFNI_18.2.14 (Aug 22 2018) [64-bit]
++ Authored by: Zhark++
++ 74520 voxels in -mask dataset
++ option -setA :: processing as SHORT form (all values are datasets)
++ option -setB :: processing as SHORT form (all values are datasets)
++ 3dttest++: AFNI version=AFNI_18.2.14 (Aug 22 2018) [64-bit]
++ Authored by: Zhark++
++ random seeds are 257892214 572051479
++ 2-sample test: '-AminusB' option is assumed
++ 2-sample test: results will be SetA - SetB
++ opened file ./tomNetwork_C2-C1_withinBrain_beta.sdat for output
++ loading -setA datasets
++ 3dttest++: AFNI version=AFNI_18.2.14 (Aug 22 2018) [64-bit]
++ Authored by: Zhark++
++ loading -setB datasets
++ 3dttest++: AFNI version=AFNI_18.2.14 (Aug 22 2018) [64-bit]
++ Authored by: Zhark++
++ Memory usage now = 16,656,471 (17 million [mega])
++ t-test randomsign/permute:++ 74520 voxels in -mask dataset
++ option -setA :: processing as SHORT form (all values are datasets)
++ option -setB :: processing as SHORT form (all values are datasets)
++ random seeds are 259003365 573162630
++ 2-sample test: '-AminusB' option is assumed
++ 2-sample test: results will be SetA - SetB
++ 3dttest++: AFNI version=AFNI_18.2.14 (Aug 22 2018) [64-bit]
++ Authored by: Zhark++
++ 74520 voxels in -mask dataset
++ opened file ./tomNetwork_C2-C1_withinBrain_beta.sdat for output
++ option -setA :: processing as SHORT form (all values are datasets)
++ option -setB :: processing as SHORT form (all values are datasets)
++ random seeds are 261225667 575384932
++ 2-sample test: '-AminusB' option is assumed
++ 2-sample test: results will be SetA - SetB
++ loading -setB datasets
++ loading -setA datasets
++ opened file ./tomNetwork_C2-C1_withinBrain_beta.sdat for output
++ Memory usage now = 16,656,471 (17 million [mega])
++ t-test randomsign/permute:++ loading -setA datasets
++ 74520 voxels in -mask dataset
++ option -setA :: processing as SHORT form (all values are datasets)
++ option -setB :: processing as SHORT form (all values are datasets)
++ 74520 voxels in -mask dataset
++ option -setA :: processing as SHORT form (all values are datasets)
++ random seeds are 260114516 574273781
++ 2-sample test: '-AminusB' option is assumed
++ 2-sample test: results will be SetA - SetB
++ option -setB :: processing as SHORT form (all values are datasets)
++ random seeds are 262336818 576496083
++ 2-sample test: '-AminusB' option is assumed
++ 2-sample test: results will be SetA - SetB
++ opened file ./tomNetwork_C2-C1_withinBrain_beta.sdat for output
++ opened file ./tomNetwork_C2-C1_withinBrain_beta.sdat for output
++ 74520 voxels in -mask dataset
++ Memory usage now = 16,656,471 (17 million [mega])
++ t-test randomsign/permute:++ loading -setA datasets
++ option -setA :: processing as SHORT form (all values are datasets)
++ loading -setA datasets
++ option -setB :: processing as SHORT form (all values are datasets)
++ random seeds are 263447969 577607234
++ 2-sample test: '-AminusB' option is assumed
++ 2-sample test: results will be SetA - SetB
++ opened file ./tomNetwork_C2-C1_withinBrain_beta.sdat for output
++ loading -setB datasets
++ loading -setA datasets
++ loading -setB datasets
++ loading -setB datasets
++ loading -setB datasets
++ loading -setB datasets
++ Memory usage now = 16,656,471 (17 million [mega])
++ t-test randomsign/permute:++ Memory usage now = 16,656,471 (17 million [mega])
++ t-test randomsign/permute:++ Memory usage now = 16,656,471 (17 million [mega])
++ t-test randomsign/permute:++ Memory usage now = 16,656,471 (17 million [mega])
++ t-test randomsign/permute:++ Memory usage now = 16,656,471 (17 million [mega])
++ t-test randomsign/permute:0000000011111111222222223333333344444444555555556666666677777777888888889.9.9.9.9.9.9.9.0000000011111111222222223333333344444444555555556666666677777777888888889.9.9.9.9.9.9.9.000000001111111122222222333333344344444555455556666666577777776888888879.9.9.9.9.9.9.800000009.11111110222222213333333244444443555555546666666577777776888888879.9.9.9.9.9.9.800000009.11111110222222213333333244444443555555546666666577777776888888879.9.9.9.9.9.9.!
++ saving main effect t-stat MIN/MAX values in ./tomNetwork_C2-C1_withinBrain_beta.minmax.1D
++ output short-ized file ./tomNetwork_C2-C1_withinBrain_beta.sdat
!
++ saving main effect t-stat MIN/MAX values in ./tomNetwork_C2-C1_withinBrain_beta.minmax.1D
** ERROR: (FAILED) attempt to over-write file ./tomNetwork_C2-C1_withinBrain_beta.minmax.1D
++ output short-ized file ./tomNetwork_C2-C1_withinBrain_beta.sdat
!
++ saving main effect t-stat MIN/MAX values in ./tomNetwork_C2-C1_withinBrain_beta.minmax.1D
** ERROR: (FAILED) attempt to over-write file ./tomNetwork_C2-C1_withinBrain_beta.minmax.1D
++ output short-ized file ./tomNetwork_C2-C1_withinBrain_beta.sdat
!
++ saving main effect t-stat MIN/MAX values in ./tomNetwork_C2-C1_withinBrain_beta.minmax.1D
** ERROR: (FAILED) attempt to over-write file ./tomNetwork_C2-C1_withinBrain_beta.minmax.1D
++ output short-ized file ./tomNetwork_C2-C1_withinBrain_beta.sdat
!
++ saving main effect t-stat MIN/MAX values in ./tomNetwork_C2-C1_withinBrain_beta.minmax.1D
** ERROR: (FAILED) attempt to over-write file ./tomNetwork_C2-C1_withinBrain_beta.minmax.1D
++ output short-ized file ./tomNetwork_C2-C1_withinBrain_beta.sdat
!
++ saving main effect t-stat MIN/MAX values in ./tomNetwork_C2-C1_withinBrain_beta.minmax.1D
** ERROR: (FAILED) attempt to over-write file ./tomNetwork_C2-C1_withinBrain_beta.minmax.1D
++ output short-ized file ./tomNetwork_C2-C1_withinBrain_beta.sdat
+ 3dttest++ ===== simulation jobs have finished (448.3 s elapsed)
*+ WARNING: Can't read file ./tomNetwork_C2-C1_withinBrain_beta.nii.gz.0000.minmax.1D
!
++ saving main effect t-stat MIN/MAX values in ./tomNetwork_C2-C1_withinBrain_beta.minmax.1D
** ERROR: (FAILED) attempt to over-write file ./tomNetwork_C2-C1_withinBrain_beta.minmax.1D
++ output short-ized file ./tomNetwork_C2-C1_withinBrain_beta.sdat
*+ WARNING: Can't read file ./tomNetwork_C2-C1_withinBrain_beta.nii.gz.0001.minmax.1D
*+ WARNING: Can't read file ./tomNetwork_C2-C1_withinBrain_beta.nii.gz.0002.minmax.1D
*+ WARNING: Can't read file ./tomNetwork_C2-C1_withinBrain_beta.nii.gz.0003.minmax.1D
*+ WARNING: Can't read file ./tomNetwork_C2-C1_withinBrain_beta.nii.gz.0004.minmax.1D
*+ WARNING: Can't read file ./tomNetwork_C2-C1_withinBrain_beta.nii.gz.0005.minmax.1D
*+ WARNING: Can't read file ./tomNetwork_C2-C1_withinBrain_beta.nii.gz.0006.minmax.1D
*+ WARNING: Can't read file ./tomNetwork_C2-C1_withinBrain_beta.nii.gz.0007.minmax.1D
*+ WARNING: COULD NOT read any .minmax.1D files for unknown reasons!
+ ==> no global threshold .5percent.txt files are output :(
+ ... this failure does not affect any other Clustim/ETAC results!
+ 3dttest++ ===== starting 3dClustSim A: elapsed = 451.2 s
++ 3dClustSim: AFNI version=AFNI_18.2.14 (Aug 22 2018) [64-bit]
++ Authored by: RW Cox and BD Ward
++ Loading -insdat datasets
** FATAL ERROR: can't find any data in file './tomNetwork_C2-C1_withinBrain_beta.nii.gz.0000.sdat'
** Program compile date = Aug 22 2018
** FATAL ERROR: ===== 3dClustSim command failed sad smiley(( =====
** Program compile date = Aug 22 2018
++ saving main effect t-stat MIN/MAX values in ./tomNetwork_C2-C1_withinBrain_beta.minmax.1D
** ERROR: (FAILED) attempt to over-write file ./tomNetwork_C2-C1_withinBrain_beta.minmax.1D
++ output short-ized file ./tomNetwork_C2-C1_withinBrain_beta.sdat


Thanks!
-LZ
Subject Author Posted

Clustsim Failed in 3dttest++

lzhyoung August 28, 2018 12:57AM

Re: Clustsim Failed in 3dttest++

rick reynolds September 06, 2018 09:10AM

Re: Clustsim Failed in 3dttest++

lzhyoung September 07, 2018 02:16AM

Re: Clustsim Failed in 3dttest++

rick reynolds September 07, 2018 10:35AM

Re: Clustsim Failed in 3dttest++

lzhyoung September 09, 2018 09:36PM