Neural Information Processing

Psignifit - Release Notes and Version History

  • Mar 27, 2007: Mex files are now included in the toolbox download for MacOS X on Intel and GNU/Linux on AMD64.
  • Oct 24, 2006: The spammers seem to be ahead in the arms race for now, so I've had to abandon the old psignifit contact address. Here is the new one.

Version 2.5.6 (18-Jan-2005)

Development on psignifit is now frozen, so none of the above will in fact happen.

Engine:

  • new LAMBDA_EQUALS_GAMMA option for a particular kind of 2AFC-without-feedback design

Matlab toolbox:

  • Matlab R14 issues worked around
  • minor bugfix in the DEVIANCE function
  • minor improvements to plotting functions like PLOTPD, PLOTPF and PSYCHERRBAR (you can now pass in axes properties as well as line properties).

Version 2.5.41 (10-Sep-2002)

This is simply an update to the toolbox m-files, to iron out the glitches caused by backward-incompatibilities in the new Matlab R13.

Further slight changes were also made to the toolbox:

  • The default number of bootstrap runs in pfit.m is now 1999 instead of 999.
  • The plotting flag ('plot', 'no plot', 'plot without stats') in pfit.m can now be passed either as the first string argument (as before) or as a "dummy" batch option called PLOT_OPT. This is in order to make things easier when writing wrappers for pfit.
  • The range function (which was causing a name conflict with the statistics toolbox) has been removed from the pfcmp distribution.

The C source should be functionally identical to 2.5.4, so I have not recompiled the binaries.

Version 2.5.4 (18-Apr-2002)

(What happened to 2.5.3? I decided to follow the convention of using even numbers in the least significant digit of the version number, in case some people think that the release might not be "stable" - in fact my development process is not so sophisticated that I ever release "cutting edge" builds or anything whose development hasn't reached a "stable" point. My version numbers are in fact assigned more or less haphazardly, and are based on how drastic the differences seem to be since I last managed to get a release posted. The next version will be 3.0.)

With this release, the name of the program has changed from "psychofit" to "psignifit". This is to avoid confusion with other software - the name "psychofit" has been used before by others. All of the source files now have lower-case names, and some of them have been renamed in other ways.

This version compiles in gcc in the new-look cygwin, and can make executables and mex files that run either natively or on top of cygwin. A primitive makefile is included.

A few bugs were fixed in the C code:

  • Fixed segmentation faults that happened on Windows when COMPUTE_STATS was turned off.
  • Fixed the fatal error that occurred when COMPUTE_PARAMS was turned off.
  • The initial size of the simplex could sometimes be set to an infinite number, resulting in a failure to converge - this was essentially a Weibull/log-slope problem, and has been solved by adding yet more strands to the spaghetti.
  • When the simplex failed to converge in the initial fit, the error message was misleading. Now it is less so.

Also, a glitch in the Matlab function psychostats.m was ironed out, whereby polynomial fits to deviance residuals were carried out even if not enough residuals existed, leading to an error.

Also in version 2.5.4, pfcmp was released. This is an extension to the Matlab toolbox, for comparing two psychometric functions by Monte Carlo simulation.

Version 2.5.2 (01-Oct-2001)

This version was used for extensive testing of bootstrap methods by Hill (D.Phil. thesis, University of Oxford, 2001). It was not released, except on the CD accompanying the thesis. It includes minor bug fixes and improvements over 2.5.1 as follows:

  • A rare bug has been fixed: when the maximum-likelihood fit yielded thresholds very close to, but not equal to 0, tiny threshold confidence intervals were produced. This was a bug in the initialization of the simplex size, which has now been remedied.
  • Use of the option GEN_VALUES when RUNS is 0 used to cause an internal error. This is a non-sensical combination of options anyway, but throwing an internal error is confusing and unhelpful if this combination is entered by mistake. This has been fixed.
  • Use of an explicit GEN_PARAMS parameter set caused the FIX_... options always to fix at the value supplied in the generating parameter set. So, it was not possible to fix a parameter at the wrong value. Now it is.
  • The names of all the Matlab m-files, and their calls to each other, have been converted to lower case - this wasn't an issue on the case-insensitive filesystems of Windows and MacOS, but it made the toolbox unuseable on most UNIX systems.
  • The guess procedure for initializing the simplex has been improved (a transformed regression is used, according to the desired function shape) making the fitting procedure more reliable.
  • A new C function MatchShape is used to identify the desired psychometric function shape, allowing new functions to be added more easily.

Version 2.5.1 (03-Apr-2000)

First success at making a Windows32 Matlab mex file - using Matlab 5.3 in conjunction with the free gcc port from Cygnus (cygwin-b20).

New features (see the file "psych_options" for documentation)
  • "Shift" and "slope" of the psychometric function (whose values can be interpreted without knowledge of which functional form of the psychometric function was chosen) can now be fixed, using FIX_SHIFT and FIX_SLOPE
  • Non-flat priors can now be applied to parameters, or to shift and slope (using LAMBDA_PRIOR, SLOPE_PRIOR, etc). Raised cosine, Gaussian, and beta functions are currently implemented.
  • The REFIT option now defaults to TRUE when a bootstrap is performed. In "verbose" mode, When REFIT is set to FALSE (either explicitly or if a generating distribution is supplied by the user) a warning is printed to remind the user that the simulated stats are non-refitted.
Minor bug fixes:
  • Fixed a bug in the sorting of distributions that contain NaNs, which resulted in non-sensical confidence limits. (NaNs occur when the maximum-likelihood search fails to converge, which happens relatively rarely, and usually only with badly sampled data sets).
  • Fixed a bug which occurs when parameters are fixed, causing distributions of slopes or thresholds to have zero variance theoretically, but non-zero variance because of numerical precision constraints. Bias-correction and acceleration terms are now set to zero in such cases, eliminating NaNs from the corresponding LIMS matrices.
  • Fixed a bug in the algorithm for determining sensitivity analysis points, which occurred whenever the number of points needs to be reduced due to sparse coverage in parameter space (this may occur with small numbers of bootstrap runs or when alpha or beta is fixed).
  • Altered the "guess" procedure for initializing the simplex search:
    • an error is now issued if the user's priors have made guessing too difficult (surface too constrained)
    • fixed a bug which caused bad initialization in certain cases (SLOPE_LIMITS specified with SLOPE_OPT log, for some data sets)
  • Fixed a segmentation fault which somehow has escaped up till now -- only uncovered in the win32 mex file version.
Internal changes:
  • Altered the internal algorithms for isnan() and isinf() from macros to functions - hopefully they will broaden compatibility with different compilers.
  • More object-oriented and expandable implementation of Bayesian priors, in a similar way to psychometric functions: each prior function is responsible for returning its name, description, and how many parameters it takes.
Backward-compatibiliy of toolbox m-files with Matlab 5.1.x:
(not yet tried with Matlab 5.0.x)
  • Replaced all try... catch... statements with eval('try_condition', 'catch_condition')
  • Replaced all occurrences of strcmpi(a, b) with strcmp(lower(a), lower(b))
  • Wrote "patch" m-files for strjust, xlim and ylim, because it was easier than programming around their absence (in the case of xlim and ylim) or limited functionality (strjust).

Version 2.5 (25-Nov-1999)

First release fully compliant with the Wichmann & Hill papers. Engine compiled and ran successfully under MacOS on PowerPC, Digital UNIX on a DEC Alpha, and Linux, 16-bit DOS and 32-bit DOS on Intel machines. No mex file yet available for Windows Matlab: this is only because I don't know how to make one...

  • Incorporated the calculation of thresholds, slopes, and confidence limits into the engine.
  • Introduced BCa method for finding bootstrap confidence limits.
  • Overhauled the syntax for specifying output, to allow users to examine the extra calculation steps thus introduced.
  • Altered the method for choosing points in sensitivity analysis: points are now chosen on the surface of a likelihood-based joint confidence region in parameter space, spread out in alpha and beta as much as possible.
  • Calculation of sensitivity analysis points now occurs within the engine (iteration of the bootstrap procedure over those points is still external, requiring repeated calls to the engine from pfit.m or the equivalent).

(The above changes required extensive changes various aspects of the engine source code, removal of a great deal of Matlab code in the toolbox that now became redundant, and changes to the input options syntax - see updated "options" documentation)

  • Added a self-test routine to aid cross-platform development.
  • Fixed a bug which caused simplex searches to fail when compiled for DOS and Linux, yielding bad parameter estimates.

Version 2.0 (standalone version 2.0-alpha) (22-Jul-1999)

First general release. Re-coded from scratch, in "strict ANSI C" with a view towards portability and optimization. All input was as text, so that mex-file and standalone versions were just "wrappers" round the same core routines. The engine compiled and ran correctly under MacOS on a PowerPC, and Digital UNIX on a DEC Alpha. Not for use on Intel systems.

  • Engine function was limited to providing bootstrap distributions of parameters and statistics.
  • The supporting Matlab toolbox files calculated thresholds and slopes, and determined confidence limits by the bootstrap quantile method (BCa method would be preferable).
  • In the central Matlab toolbox function, pfit.m, sensitivity analysis was performed by the "crude square" method: points were chosen on the sides and corners of a rectangle in parameter space, whose sides measured the 68% confidence intervals in alpha and beta.
  • Without Matlab, the standalone engine was an alpha release only - it could only, very crudely, give the mean and standard deviation of the bootstrap parameter distributions (NOT recommended for hypothesis testing).

Version 1 (1997-9)

Implemented fitting and simulation as a compiled binary plug-in to Matlab (mex file) which worked on Macintosh PowerPCs. This cut processing times by a factor of 50-100, but was still poorly optimized. Functionality was very limited.

Version 0 (1996/7)

First attempt at Monte Carlo simulation of a multi-dimensional Simplex search fitting psychometric functions according to maximum likelihood. Implementation was Matlab scripts only: took 20-30 mins to do 1000 simulations. Often failed to converge.