To remove just libmath-bigint-gmp-perl package itself from Debian Unstable (Sid) execute on terminal:
sudo apt-get remove libmath-bigint-gmp-perl
Uninstall libmath-bigint-gmp-perl and it's dependent packages
To remove the libmath-bigint-gmp-perl package and any other dependant package which are no longer needed from Debian Sid.
sudo apt-get remove --auto-remove libmath-bigint-gmp-perl
If you also want to delete configuration and/or data files of libmath-bigint-gmp-perl from Debian Sid then this will work:
sudo apt-get purge libmath-bigint-gmp-perl
To delete configuration and/or data files of libmath-bigint-gmp-perl and it's dependencies from Debian Sid then execute:
sudo apt-get purge --auto-remove libmath-bigint-gmp-perl
More information about apt-get remove
apt-get remove is identical to install except that packages are removed instead of installed. Note that removing a package leaves its configuration files on the system. If a plus sign is appended to the package name (with no intervening space), the identified package will be installed instead of removed.