maybe one of the potters married a black... Remember pretty much all wizard families were often related to each other (in some way or another) and they'd often marry each other... but that james is family of sirius by birth, no, but one of his family members could've possibly married a black...