Yup. You can. It doesn't matter whether it's first or third person either.
The only thing is that you should probably put the character (whose POV it is) name as the the chapter title. Or, for instance, If your characters were named Bob and Bobbilina, then you could say:
Chapter One: Bob
Chapter Two: Bobbilina
Or, if you name your chapters and one was called, let's say, The Journey then it could be like:
Bob: The Journey
As long as you specify which character it is, you'll be sweet.