That’s one of the concerns. Here’s more, from https://www.eff.org/issues/national-ids

Mandatory national ID cards violate essential civil liberties. They increase the power of authorities to reduce your freedoms to those granted by the card. If a national ID is required for employment, you could be fired and your employer fined if you fail to present your papers. People without ID cards can be denied the right to purchase property, open a bank account or receive government benefits. National identity systems present difficult choices about who can request to see an ID card and for what purpose. Mandatory IDs significantly expand police powers. Police with the authority to demand ID is invariably granted the power to detain people who cannot produce one. Many countries lack legal safeguards to prevent abuse of this power.

Historically, national ID systems have been used to discriminate against people on the basis of race, ethnicity, religion and political views. The use of national IDs to enforce immigration laws invites discrimination that targets minorities. There is little evidence to support the argument that national IDs reduce crime. Instead, these systems create incentives for identity theft and widespread use of false identities by criminals. National ID cards allow different types of identifying information stored in different databases to be linked and analyzed, creating extreme risks to data security. Administration of ID programs are often outsourced to unaccountable companies. Private sector security threat models assume that at any one time, one per cent of company employees are willing to sell or trade confidential information for personal gain.