This applies when your domain uses our nameservers. If your DNS is somewhere else, change the records there instead. See How DNS works (records and propagation) for what the records do.
Open your domain in Plesk, click the Hosting & DNS tab and then DNS. The Records tab lists each record with its host, type and value. Plesk creates the standard records (A, CNAME, MX, SPF and others) for you when you add a domain.
Click the record's name, change it, and click OK. To remove records, tick them and click Remove.
DNS changes can take time to show everywhere. Records can be cached by other servers until their TTL runs out.