I forgot this step, actually I think dgitalocean forgot to add this to their documentation.
Once you've finished installing PHPMyAdmin we need to add it to Apache's config:
sudo nano /etc/apache2/apache2.conf
Add this to the bottom of the file:
Include /etc/phpmyadmin/apache.conf
Once that's finished restart Apache and we can move on:
sudo service apache2 restart