How long have you held that status, and how long have you lived in Poland legally?
You need one of three: three years holding the permanent status; ten years of continuous legal residence in Poland in all, including temporary permits, while now holding it; or two years on a permanent residence permit granted through refugee status in Poland. The grant date is on your permit decision. Long or frequent absences can break continuity.