No, the adverb 'pas assez de' can be also be used with plural nouns:

Mon appartement n'a pas assez de pièces. -- My apartment doesn't have enough rooms.