Set environment variable AFNI_X11_REDECORATE to NO. This will prevent AFNI from removing the standard window "decorations" from minor popup windows.
If you need to know more about setting environment variables, see README.environment, which is available in the AFNI source code distribution and somewhere on this website.