Is it common for a car to lug down in first and second gear if you take your foot off the gas?

Ok, i know that this sounds stupid, cause I know that when the cars rpms are too low it stalls. And while I have never stalled my car, when I take my foot off the gas in first and second gear, the car kinda chugs forward. Am I supposed to push in the clutch when i take my foot off the gas in first and second (cause it does this even if the car is at high rpms or like 3000)? It also only happens in first and second, third fourth and fifth are fine. the car is a 1986 300zx turbo, if that makes a difference