In this contribution to INTERSPEECH 2010 Paralinguistic Challenge we explore the capabilities of decision level fusion and ensemble based techniques for classi?cation tasks on the provided AGENDER corpus. Ensemble members are gener- ated by providing multiple feature sets generated by feature selection, and novel fusion methods (developed in order to give special support to under-represented classes) are applied for decision making. Results are compared to standard classi?cation approaches and possible benefits are discussed.