Other books which are more linguistics oriented (although not neccessarily corpus-oriented) are Kenny (1982), and Woods, Fletcher and Hughes (1986).
On specific issues, Church et al (1991) discuss mutual information in detail, while loglinear modelling is tackled by de Haan and van Hout (1986). Alt (1990) provides a relatively accessible introduction to factor analysis and cluster analysis.