When did Dumbledore become headmaster of Hogwarts?

I know that he was Transfiguration professor before, but was he still a professor during the time that Sirius Black and James Potter went to Hogwarts? Or was he already headmaster?