This paper deals with the problem of exploiting information from a wide phonetic context for the purpose of language identiffication. Two approaches to language modeling are presented here: 1) modified bigrams with a con- text-mapping matrix and 2) language models based on binary decision trees. Both models were incorporated in a phonotactic language identiffier with a double-bigram decoding architecture and were shown to consistently improve the performance of standard bigrams. Measured on the NIST'95 evaluation set, the described system outperforms the state-of-the-art phonotactic components and is, at the same time, computationally less expensive.