When your parent was born, was that grandparent still a Japanese national?
Your parent must have been born as the child of a Japanese national. Living abroad or letting a passport lapse does not end Japanese nationality; taking another citizenship does, on the day it is granted.